7 Tips. for Better Automated QA Testing

Transcription

1 7 Tips for Better Automated QA Testing

2 Introduction You wouldn t send out a sales presentation, a marketing brochure or a bid package without having a competent, properly trained employee proof it, would you? Seriously, would you? 1

3 Something as simple as a misspelled name or a miscalculated bid amount can mean the difference between making the sale and coming up empty-handed. Little errors look and feel much bigger once they re viewed by the wider world. They can sully your company s reputation and standing in the market. Taking a little extra time and investing in a little expertise on the front end can actually save you time and money in the long run. 2

4 The same can be said with quality assurance (QA) testing of web, mobile, cloud and legacy applications. You can think of it as proofing your apps, but that s just half the story. QA testing can ensure that applications load quickly and accurately, perform at an optimal level, maintain data safety, return accurate results and promote a positive user experience. While it does not eliminate the need for some manual testing, automated processes can help your company stretch development budgets while maintaining the quality of your applications. 3

5 READY TO BEGIN AUTOMATED TESTING? Here are 7 tips to get you started. 4

6 1. Put the right resources in place 2. Discover what s possible 3. Pick the right tool for the job 4. Identify the proper framework 5. Plan before you deploy 6. Take action on your findings 7. Review, retain testing scripts 5

7 When used properly, automated QA testing can reduce cycle times, improve time to market, adequately handle complex applications, and maximize limited resources But your IT staff has to know how to evaluate and select the right tool and framework for what you need to test, develop standards, run the tests, then properly interpret the results. 6

8 If testing is not a strong suit for your organization, consider outsourcing this portion of the work. The select partner should have vast experience in testing protocols, frameworks and the particular requirements of your industry. Action step: Evaluate your IT staff s experience with test automation, and consider bringing in an outside partner if their experience is found to be lacking. 7

9 1. Put the right resources in place 2. Discover what s possible 3. Pick the right tool for the job 4. Identify the proper framework 5. Plan before you deploy 6. Take action on your findings 7. Review, retain testing scripts 8

10 Any organization considering automated QA testing should begin with a feasibility study of the project. Conducting a study beforehand may sound like wasted time, but it s an important component of a successful automation plan. 9 9

11 If you re not ready... you ll just be wasting time and resources (i.e. money) that would be better spent elsewhere. Action step: Think before you act by conducting a feasibility study. 10

12 1. Put the right resources in place 2. Discover what s possible 3. Pick the right tool for the job 4. Identify the proper framework 5. Plan before you deploy 6. Take action on your findings 7. Review, retain testing scripts 11

13 Automated QA testing tools run the gamut in terms of price and utility. The key is to find the right tool, one that matches the type of application you re testing. In many cases, a general testing tool will do the job. But some specialized applications require specialized tools to test sufficiently. 12

14 And then there are price considerations. Companies pay big bucks for testing tools they don t use effectively (or use at all). Open source tools may be a cheaper alternative but only if your staff knows how to deploy them correctly. Action step: Get familiar with testing tools, both paid and open source, as well as the experience level of your staff in using automated testing tools. 13

15 1. Put the right resources in place 2. Discover what s possible 3. Pick the right tool for the job Identify the 4.proper framework 5. Plan before you deploy 6. Take action on your findings 7. Review, retain testing scripts 14

16 Selecting the right framework and scripting techniques can help you control the development and maintenance costs for this application and, perhaps, others in the development pipeline. For software automation testing, wise framework choices include data-driven, keyword-driven, modular and hybrid approaches. 15

17 Your staff should be adept at designing and implementing frameworks. They should also be conversant in such programming languages as C#,.Net, Java, Perl and Python. Action step: Make sure you have the proper QA resources and tools in place to support the development of the framework from conception to completion. 16

18 1. Put the right resources in place 2. Discover what s possible 3. Pick the right tool for the job 4. Identify the proper framework 5. Plan before you deploy 6. Take action on your findings 7. Review, retain testing scripts 17

19 We ve all heard the saying that when you have a hammer, everything looks like a nail. Don t become complacent by thinking that having the right tools and framework are sufficient to complete automated QA testing. You also need a testing plan, one with defined development standards that can be followed by the testing staff

20 This methodical approach can help ensure that automated tests can be repeated, reused and maintained. Action step: More companies are adopting testing centers of excellence (TCOE) to guide the selection and use of testing tools and frameworks to maximize resources and the opportunity to reuse tools and tactics. 19

21 1. Put the right resources in place 2. Discover what s possible 3. Pick the right tool for the job 4. Identify the proper framework 5. Plan before you deploy Take action on 6.your findings 7. Review, retain testing scripts 20

22 Running the automated tests is just the first step. The pass/fail results should be analyzed for trends, and the appropriate stakeholders should review the comprehensive test results. 21

23 Many testing tools include dashboard views of the test results. These can help executives and other stakeholders understand what s going on at a glance. Action step: Determine the reporting functionality of any automated testing tool you select. All things being equal, a stronger reporting function may prove useful in getting and keeping buy-in from key executives. 22

24 1. Put the right resources in place 2. Discover what s possible 3. Pick the right tool for the job 4. Identify the proper framework 5. Plan before you deploy 6. Take action on your findings 7. Review, retain testing scripts 23

25 Automation scripts can be readily reused for subsequent release cycles of a particular application or in some cases used to test similar applications. Your IT staff should be able to review, add and maintain automation scripts. 24

26 You should get the most bang for your buck out of testing. This should happen regardless of whether you re using proprietary tools or open source tools. Cost of a Software Bug $100 If found in the Gathering Requirements phase $1,500 If found in the QA Testing phase $10,000 If found in Production Action step: Make sure that the tools, frameworks and scripts you are using for your automated QA testing can be repurposed and reused effectively. 25

27 Conclusion Automated QA testing is a critical component of any software development project. Before starting, you should ensure that your IT staff have the right people and resources in place to see the project through to completion. Otherwise, you should consider bringing in a partner who has deep experience in testing. 26

28 If you choose to outsource look for a partner with proven expertise in commercial testing tools as well as open source tools you may want to consider. A partner should also be able to help you create a test strategy and a roadmap that incorporates all types of testing. But most important, you need a partner to give you and your project the attention it requires, including access to senior level resources. 27

29 GOT MORE QUESTIONS ABOUT AUTOMATED QA TESTING? Just let us know. We get you past the bottlenecks! solutions.pyramidci.com Pyramid Solutions Atlantis Place Alpharetta, GA 30022