NFT Services in an agile environment

Size: px

Start display at page:

Download "NFT Services in an agile environment"

Ira Garrison
6 years ago
Views:

1 Agile Practitioners IL - 7 th Meeting 17/4/12 NFT Services in an agile environment Kstudies - Karen Schlaien Karen.schlaien@gmail.com,

2 Presentation Objectives Production readiness awareness into scrum teams Agile adoption in a multitasksmultiproduct-multitimelinemultiexperts environment

3 Agenda NFT Role and Targets in the Organization The team NFT Categories NFT in SDLC Agile adoption CNFT and NFT Done criteria Solution implemented

4 Can the system cope with number of users that are accessing it? Is the hardware powerful enough to support the required load? Is the software efficient enough? Is the system stable under heavy load? Is the system able to scale? Till what limit? Does the system knows how to recover after failure without loosing any data? How long it takes? Does new development affects system performance? And more ilities questions

5 Targets for the SPOT group of experts The group name reflects the main task and targets of the group. Scalability, Performance, Operability &Tuning Testing is one of the tools to perform our work Learn & Investiga te SPOT aspects Technolo gy GURU Recomme nd Teach

The Team Software Developers and ADBAs Experts in the development technologies Languages (C++, Java) for profiling Databases (Oracle/DB2) for tuning System (O/S,

6 The Team Software Developers and ADBAs Experts in the development technologies Languages (C++, Java) for profiling Databases (Oracle/DB2) for tuning System (O/S, Network, I/O) for analysis Middleware (Weblogic, Websphere) Inflation of Events, Customers Profiling and Monitoring tools Development of Simulators Advanced Coding techniques

The Team Cont Testers Highly qualified in Business Knowledge Experience with testing methodologies Good knowledge of the tested modules Knowledge in testing

7 The Team Cont Testers Highly qualified in Business Knowledge Experience with testing methodologies Good knowledge of the tested modules Knowledge in testing tools (LoadRunner, UNIX scripts, etc.) Ability to identify initial problems Instability Non scalability Memory Leaks Ability to Analyze the results and document them

8 SPOT Role in the Organization Deal with production sites challenges Test Customer specific scenarios Help in troubleshooting and tune the system POCs Define system enhancements Define the NFT targets Analyze results Assess alternate technologies Customer requirements Product Management Development Design Code Review Investigate complex problems Technical support ( DBA, network, WL) Functional under load Functional scenarios on complex environments Enhance functional scenarios Functional Tests SPOT Configuratio n and sizing teams Lab configuration definition Architecture and new Technologies Results Analysis Apply results to Production sites Evaluate new technologies - POCs Certification of new versions Comparison between vendors Benchmarks Vendors System O.S, network, i/o configuration and consulting Advanced tuning tips Advanced system monitoring

9 Functional Vs. Non functional Tests Complementariness Share Automation Share Simulators Data inflation Business knowledge Risk analysis scope Same Timeline Functional Security Operability Usability Upgrade HA Business Processes NFT Security Operability Usability Upgrade HA Business Processes

10 NFT role in Development Life Cycle

11 NFT Influence Waterfall SDLC Requirement Design Development Testing Launch and Deployment time

12 NFT Influence Target for agile environment Requirement Design Development Testing Launch and Deployment time

13 Portfolio Release Iteration/Release I Iteration/Release II Opportunity Team Iteration 1 HL Planning Iteration 2 HL Planning Development Team Sprint N Internal Release Defects Sprint N+1 Sprint N+2 R2 Sprint N Integration Team Integration Test N Integration Test N+1 R1 End Game Product Release

14 SPOT Roles in Scrum teams - Orange Scrum Master Developers employee that fulfills the objectives of this role) 3-4 people Component Test 1-2 people SPOT % Percentage Technical Writer % Infra & Implementation % Percentage Percentage 1 4

15 Blue Teams System Integration test Implementation Infra Technical Writers SPOT

CNFT and NFT tasks NFT tests can be performed in two phases Iteration N - During Development iteration Component testing Sterile test Iteration N+1 - The

16 CNFT and NFT tasks NFT tests can be performed in two phases Iteration N - During Development iteration Component testing Sterile test Iteration N+1 - The previous iteration is tested as part of flows and regression to the existing functionality. Dev I1 Dev I2 Dev I3 CNFT I1 CNFT I2 CNFT I3 NFT I1 NFT I2 NFT I3

17 CNFT activities Scrum team (orange) Design participation Test design (Simulators, data prep, automation) Execute Baseline Regression for further comparisons DB performance analysis (SQL tuning, indexes, partitions) Mini Stability Profiling Partial Scalability KT to Blue teams

18 CNFT Entrance & Done Criteria Entrance Criteria Tested component works Analysis tools installed on machines. DB Upgrade is available between iterations. Done Criteria No MLK in the new functionality and affected regression Component is stable (mini-stability definition per application) No scalability problems DB analysis completed Knowledge Transfer for NFT Done Automation Ready

19 NFT activities Blue team Design participation Test design integration (Simulators, data prep, automation) Operability and E2E flows System regression 72hs Stability Production Lab performance results Scalability

20 NFT Entrance & Done Criteria Entrance Criteria CNFT achieved done criteria Done Criteria Execution completed Component targets achieved. No performance degradation Component is stable (new and regression) Result summary report + defect report ready Defect retesting ( pending capacity availability)

21 How can we manage it?

22 SPOT activities POCs AE tasks (new enhanceme nts) Automatio n Stability tests Defect rollups retest Operability and E2E flows NFT tasks Scalability tests CNFT representat ive Blue Team Upgrade tests

23 SCRUM adoption? Backlog Support to development Scrum teams Daily meetings Planning session Retrospective Burndown charts New roles in the team Focus masters New Manager role x Different timeline x AE x other products, x POCs x Defects and Ad-Hock activities influenced on commitments

24 Backlog POCs AE tasks (new enhanceme nts) Other products Automatio n Stability tests Defect rollups retest Operability and E2E flows NFT tasks Scalability tests CNFT representat ive Blue Team Upgrade tests

25 Solution

26 SCRUMBAN in SPOT Group divided in Scrum groups of ~7 experts Participation in orange scrum group (priority) Scrum master Manager role definition changed (direct management, discipline management) Backlog included all SPOT activities Planning session WIP mgmt for the next 3-4 weeks (independent from products timeline) Target to increase versatility in the team (tasks) Daily meetings Retrospective sessions

27 Challenges - Targets Increase readiness awareness Product owner define clear NFT stories/features Development use of profiling tools, operability Functional tests reuse of automations and knowledge, synergy between groups Reduce timeline to test within the same sprint/iteration Increase team versatility

28 Questions?

29 Thank you and Good luck!

Scrum Testing: A Beginner s Guide

Scrum Testing: A Beginner s Guide What is Scrum? Building complex software applications is a difficult task. Scrum methodology comes as a solution for executing such complicated task. It helps development