Almac Group Leverages Scriptless Test Automation to Improve Application Quality and Delivery November 18, 2015

Transcription

1 Almac Group Leverages Scriptless Test Automation to Improve Application Quality and Delivery November 18, 2015

2 Brought to you by

3 Hosted By: Becky Karch Vice President of Customer Success TurnKey Solutions

4 Today s Speakers Shauna Quinn Software Test Manager Almac Becky Karch Vice President of Customer Success TurnKey Solutions

5 Housekeeping This LIVE session is being recorded Recordings are available to all Vivit members Session Q&A: Please type questions in the Questions Pane

6 Webinar Control Panel Toggle View Window between Full screen/window mode. Questions

7 Almac Group Leverages Scriptless Test Automation to Improve Application Quality and Delivery Shauna Quinn Almac Group Becky Karch TurnKey Solutions

8 8 Key Learning Points How to build a better alternative to manual testing methods How to streamline operations and shrink testing cycles from weeks to days How to quickly and easily validate core business systems w/ a comprehensive regression suite Best practices in developing a solid testing strategy moving forward

9 9 About TurnKey Solutions Founded 1989, HP/Mercury technology partner since 1995, HP OEM Partner since 2012 Privately held, HQ in Denver, CO with offshore operations in India Global presence growing customer presence across all continents Our scriptless automated testing solutions are built exclusively on the industry leading HP ALM technology stack* Scriptless automated testing enables broad use for hundreds of application types using a common set of tools, by business users, TCOE s and QA experts

10 10 About Almac Award-winning global contract development and manufacturing organization for the pharmaceutical and biotech industries Privately owned with headquarters in Craigavon, Northern Ireland; operations in the UK, across the US (Pennsylvania, North Carolina and California) and in Asia (Singapore and Tokyo). Company has grown organically over 30 years and now employs in excess of 3,900 highly skilled personnel. Almac services include Diagnostics & Biomarker Development, API Services & Chemical Development, Pharmaceutical Development, Analytical Services, Clinical Services, Clinical Technologies and Commercial Services

11 Need for Automation

12 12 Almac Business Environment Almac uses Oracle EBS to run core business critical functions 100% manual testing Although the knowledge and skills are within the test team, we rely heavily on the business to provide resources

13 13 March 2014: ERP system upgrade 9 month project 7 manual test cycles (4729 manual tests executed) Team 20 (comprised of Business Users & BA s) 12 week end-to-end UAT cycle Conclusion - Automation was required

14 14 Automation Software Evaluation A lot of research was carried out - decided to do a POC on 3 test automation solutions POC Process Screens are analysed and components are created End users evaluated tools on list of key criteria Also needed extensive support for the Oracle ERP (ebusiness Suite) coverage and maintenance The decision was made to go with TurnKey s cfactory Support for Oracle EBS Integration with QC Separate data from test Ease of use Component reusability End-to-end flow building Out of box content Ease of maintenance

15 Building the Test Framework

16 16 Approach The Team QA Manager Oracle EBS Project Manager / Oracle SME 2 Test Leads 1 Test Automation Engineer Business Analysts

17 17 Approach A core automation team of 2 Almac testers was created Ring fenced to ensure 100% dedication to the implementation During the implementation stage the Almac automation team worked alongside Turnkey Customer Success Team (CST) personnel Training was conducted for the entire team Test creation began Created new components Amended existing components Mentoring through any issues which arose

18 18 Training & Mentorship Assess Current Tests What do your current tests do? How are they written and do they cover what they should cover? How stable is your application? Assess Test Tools How and where do you organize your tests? Do you have an automated test tool? Do you use it? How often? Staffing The Necessary Testing Resources What skills does your team have? Can you hire more resources? Can you share/integrate roles & responsibilities? Getting Feedback Do you have enhancement request tracking? What services do your customers ask for? What Support issues come in?

19 19 Approach The 2 end-to-end business scenarios used during the upgrade UAT were identified as being the starting point for this work stream Full data flows through the system, e.g. creating customer to invoicing Targeted for completion Dec 2015 Manual tests that fulfilled the scenarios were identified and planned in conjunction with Turnkey Customer Success Team (CST) personnel The newly created components were linked together with prebuilt components to create test scripts Test scripts were linked to create test sets for the end-to-end flow and the datasheets were created and populated

20 20 Building the Framework 1 st Scenario consisted of 273 test scripts linked end-to-end Each test script contains an average of 20/30 components 1 master datasheet to allow the data to be created and consumed within the flow Reusability of components for future scenarios; therefore reducing time in future test development

21 21 How it works Manual Order Entry Form in ERP system

22 22 How it works cfactory analyses the screen and creates test components.

23 23 How it works Components are then combined together to make a test script in the test plan section of QC/ALM.

24 24 How it works The test script is added to the Test lab in QC/ALM and a datasheet is created.

25 25 How it works The datasheet details all the components of the test. Data is added and multiple scenarios specified.

26 26 How it works 273 test scripts linked to create complex end-to-end flow throughout the entire ERP system.

27 27 How it works Master datasheet allows data to flow throughout the tests.

28 28 Current Uses of Scenario #1 3 Optimisation projects running in parallel in 3 environments Project 1 It is being executed repeatedly on 1 environment to identify issues with a large number of patches and code Project 2 It is being executed on a separate environment as part of the formal ST cycle for regression testing Project 3 A subset of test scripts are being used to create data in a separate environment

29 29 Current Results End-to-end testing initially took 12 weeks to complete; with TurnKey, this is now done in 3-4 days Testing required 20 people to assist in the process; this has been reduced to minimal effort by business resources and 1 person checking and carrying out manual steps Coverage has allowed us to find issues that were missed in manual testing as well as defects found earlier in the development process

30 Adding Value Across the Business

31 31 Next steps Monthly Support Release Will run each month once the support releases have been completed manual testing; end-to-end validation prior to going Live. Project Work To test patch impact To reduce regression timelines in formal ST To create test data To run the end-to-end to a point and then create multiple iterations to challenge specific areas The 2 nd scenario is in progress - complete Dec 2015 Able to re-use approx. 50% of components from scenario #1 Once complete we will have automated the UAT test cycle

32 32 Next steps Create smaller regression packs for extensions with a high volume of change Use in projects or in support releases Use automation to create data within the system less reliance on production data Automating opening the finance periods in DEV and ST environments

33 33 Supporting Automation Minimal BA support for on-going automation adoption Automation Team consists of 2 testers New Team involvement in Agile projects Part of the Agile team Aiding dedicated manual tester Identify maintenance required based on changes

34 34 Current Results Preparation is key Know what you want to automate and why Have the manual steps and flows documented prior to commencing any automation Design the test flow to create and consume its own data Get the right people involved Dedicated team to participate fully in the implementation Ring fence the resources Team should be keen to learn and enthusiastic No automation experience is required Track progress Initial scope nailed down Targets tracked Key milestones identified

35 Questions

36 HP Discover 2015 London Use this unique Vivit link: when you register for Discover 2015 London Enter your Vivit ID and you can still receive the Early Bird discount!

37 TurnKey at Discover 2015 London Join us at Vivit s Guru Bar for TurnKey s Roundtable Discussion on Scriptless Test Automation on Thursday, December 3, 2015, 9:00-10:00 AM BST Registration Link for Attendees: Stop by TurnKey s Booth #532 for a live demo and enter for your chance to win an RC Drone Camera!

38 Visit the Vivit Booth in the Transformation Zone Vivit s the Ticket Let Vivit be your Ultimate HPE Tour Guide With having over 30K members worldwide, Vivit is proud to have the best and brightest as its members and volunteers. Bring your colleagues over to our booth so that we connect you with other members, special interest groups, local user groups, and the elected board of directors. We invite you to take a selfie at our London themed booth and register to win one of Vivit s great travel prizes.

39 Register for a Vivit Discover London Breakout Session Speaker: Gordon Appleby Technical Director Trust IV Ltd Session ID: TB7449 Wednesday, Dec 2 12:00 13:00 Title: Service and Network Virtualization in testing. Speaker: Dr. Mik Kersten Chief Executive Officer and Co-Founder Tasktop Session ID: BB7448 Tuesday, Dec 1 10:30 11:30 Title: Don't let your DevOps transformation fail: Unleash developers with lifecycle integration Speaker: Mark Laird Vivit BSM SIG Leader and Group IM Technical Architect Steria Ltd Session ID: TB7446 Thursday, Dec 3 12:30 13:30 Title: Improving the customer experience with HP Propel and Avatars Speaker: Pedro Miguel Jeronimo Mendes Business Unit Manager Datasmart Session ID: BB7447 Wednesday, Dec 2 16:30 17:30 Title: Protect your Business now Copyright 2015 Vivit Worldwide

40 Thank you Complete the short survey and opt-in for more information from TurnKey.