The Changing Role of QA Manager in an Agile World. Udi Weinberg ADM QA Director, Micro Focus

Transcription

1 The Changing Role of QA Manager in an Agile World Udi Weinberg ADM QA Director, Micro Focus

2 Agenda About Changes Challenges Next

3 $$$ +

4 The New Combined Company: Built on stability, acquisition and innovation COBOL Network Management/ Data Protector 10K+ enterprise customers 15acquisitions 99years of combined innovation

5 Microsoft Oracle SAP Salesforce Adobe Symantec New, Combined Microfocus CA Dassault Gemalto Citrix SAS HPE SW Synopsys Red Hat Open Text Constellation Asseco Veritas CDK Global Autodesk Infor Nuance BMC Cadence Check Point Workday Service Now Micro Focus Trend Micro # 7 # 12 Combined Micro Focus An Industry Shaper #

6 About Me 19 years in the Software world, mostly in QA 7 years in several startups Joined Mercury( HP\E\Micro Focus) 12 years ago Served in variety of roles in QA as Engineer, Team Lead, Group Manager In the past 3 years I was leading the ADM (Application Delivery Management) QA organization Just moved to R&D 6

7 Application Delivery Lifecycle Management Release Applications With Confidence Through Collaboration, Automation & Visibility Functional Robust Modern Testing Solutions Mobile User Experience Testing Performance Validate Applications To Business Need Virtualization Understand & Emulate Production Environments

8 Application Delivery Lifecycle Management Release Applications With Confidence Through Collaboration, Automation & Visibility Application Lifecycle Management Build & Release Applications with Confidence Quality Center ALM Octane Integrated & Open platform for NextGen Application Delivery Project and Portfolio Management

9 Sprinter Manual & Structured Exploratory Testing Unified Functional Testing Automated Functional GUI & Service Testing Functional Robust Modern Testing Solutions LeanFT Automated Agile Testing in the IDE StormRunner Functional Testing the apps of tomorrow - Today

10 Mobile Center Application User Experience Testing for Real World Conditions Mobile User Experience Testing AppPulse Mobile On Demand Mobile Application Crowd Testing & Analytics

11 Performance Center Enterprise Performance Testing LoadRunner Project Based Load Testing Performance Validate Applications To Business Need StormRunner Load Intuitive Agile Cloud Based Performance Testing

12 Network Virtualization Test an Application Under Real World Conditions Service Virtualization Simulate Production Environments Virtualization Understand & Emulate Production Environments

13 Application Delivery Lifecycle Management Release Applications With Confidence Through Collaboration, Automation & Visibility Functional Robust Modern Testing Solutions Mobile User Experience Testing Performance Validate Applications To Business Need Virtualization Understand & Emulate Production Environments

14 Our Agile Journey (~6 years) Capacity - 8 products Capacity 15+ products Major release months SaaS release 4-8 weeks Quarterly On-prem release Build to QA 2-4 weeks Build to QA Hourly/Daily On demand automation for specific areas Fully Automated CD Pipeline

15 How Continues quality Adopt and adjust Agile and DevOps practices Technology Heavily invest in automation People The Evolution of QA engineers 15

16 Work Mode Today All teams work according to Agile principles (user stories, sprints, DoD, CFD ) Variants between: o On-prem and SaaS products o New and Classic QA is Centralized at Pillar (Domain) level Working in dedicated SCRUM teams 16

17 What We Learned From Our Enterprise Customers Shifting in all Directions Shift Left More technical, code based testing Part of CI and build process Main problems lack of skill set, not all manual QA can make the move, costly to develop and maintain automation Shift Down Power to the team at the LOB, tools of choice, dev is the king Main problems lack of visibility, duplicated efforts, no standards 17

18 What We Learned From Our Enterprise Customers Shifting in all Directions Shift Left More technical, code based testing Part of CI and build process Main problems lack of skill set, not all manual QA can make the move, costly to develop and maintain automation Shift UP Need for tools to consolidate the big picture, TCoE experts to set standards and practices Shift Down Power to the team at the LOB, tools of choice, dev is the king Main problems lack of visibility, duplicated efforts, no standards Shift Right Scriptless automation to allow non technical users to contribute 18

19 Market Trends * World * World quality quality report report

20 The Classic Role of The QA Manager Reflect status and call for actions Monitor progress (test coverage, defects, automation) Project Lifecycle Plan (tests, time and capacity) Allocate resources Track and coordinate execution Test Env Assign tasks

21 What Happens When You Go Agile Reflect status and call for actions Done is Done Plan (tests and capacity) Sprint Planning Monitor progress (test coverage, defects, automation) Done in SCRUM/ PMO SCRUM Team Allocate resources Fixed per SCRUM team Track and coordinate execution Done in SCRUM team Test Env Automatic \ DevOps Assign tasks Done in SCRUM team

22 ADM Modern Software Lifecycle Adopting DevOps External pressures drive business and IT to collaborate and release faster This drives teams to adopt Agile & DevOps practices. This changes everything for QA Exploding software complexity The rise in composite and service oriented architecture adoption, and software surface areas from web to mobile to things Complexity grows to the point of chaos Cloud Transformation Software dev is shifting from mostly custom code creation to cloud service compositions. Consumption preference is shifting to cloud and utility models It s about Cloud 22 This is shifting Enterprise Control Points Organization Realign from IT centric to LOB projects with self-service Technology Move from enterprise architecture to development dominance Deployment Shift from release trains to DevOps deployment automation Requirements Elicitation and sign-off Dynamic backlog Continues Quality Focus less on quality management and more on done criteria

23 So, do we still need QA managers...? 23

24 24 Don

25 Top 5 Challenges for the QA Manager in an Agile World 1. The day to day of the engineers is not with the QA team 2. QA engineers are not the classic testers anymore 3. User story granularity makes it hard to see the big picture 4. Running, analyzing and maintaining massive automation 5. Reflecting quality status and not just velocity 25

26 People and Team Building - Recruiting and training the right mix of people - Career development - Testers vs. coders - Manual vs. automation balance 26

27 Managing the Automation Assets - Decide what, when and how to automate - Track the CI pipelines and automation tests outcomes and take action when needed - Organize the automation to meaningful packages and keep optimizing them 27

28 Quality and Status Reflection - Track and reflect quality at product\business level - Work directly with customers - Test E2E, user centric scenarios - Use production data - System wide and non functional aspects - Constant process improvements 28

29 Our The World is changing Changed Agile changed the way we develop and test software QA org is the one mostly impacted by this change QA manger is the role that needs to change the most We need to change the way of thinking, take new roles and responsibilities and stay relevant 29

30 Thank you.