Testing in Design. James Huff

Transcription

1 Testing in Design James Huff

2 Learning Objectives At the end of this session, you will be able to: 1. Describe at least three ways to test your projects 2. Describe how prototypes can be used in testing 3. Categorize potential failures for a design

3 Testing How do we know our projects will work? o When we deliver it? o For the intended life? What is the expected life? How do we know the project will function like we want and for the users intended? How do we know we are meeting the right needs?

4 Testing Designers have to know that their design will function o Plan testing along the way Tests look at o Function does it perform like we intended Under what conditions? o User testing does it meet needs Can people use it as intended

5 Fail quickly and cheaply Prototyping.rough, quick, very interative o IDEO working with Gyrus ACMI to design new apparatus for operating on delicate nasal tissues o Prototype:

6 Think, pair, share. What questions and/or issues need to be tested for your current project? Find one or two others to share your answers o Introduce yourself o Describe your project o Answer the first question

7 More discussion Individually o What tests need to be done on the project? Share what you answered for your project with the same person or pair.

8 Test plans Create a test plan for your design o What tests need to be done? o What will they measure? o What are the criteria for success and failure?

9 Test Plans What will be tested Who and/or where will it be done What will be measured? Success or failure Test #1 Test #2 Test #3 Test #4 Clearly define what will be done and by whom

10 Sample Test Plan Template Sharepoint > Teams > Shared Documents > Templates_Tools > Test Plan Template.docx 1 Description of Product 1.1 Components of interest Dimensions Photographs 1.2 Specific, important characteristics Materials, tolerances, limitations How close is this test vehicle to the expected final product 2 Objectives of Test 2.1 Overall goal (characterization, optimization, test to failure, e.g.) 2.2 Specific parameters to be measured 2.3 Target values of outputs 2.4 Test Success Criteria Definition What new knowledge will you have gained How will you use the new knowledge Is the comfort/safety of humans interacting with the product compromised 2.5 Is a redesign required

11 More Template 3 Equipment List, Test Location 3.1 For every output parameter, there should be a way to measure it Camera should generally be included to photograph/video the set up, test point execution 3.2 Description of test location 4 Test Procedure 4.1 Define conditions Normal conditions Static or steady cases Dynamic cases Failure or emergency conditions

12 More Template 4.2 Define inputs Controllable inputs, ranges for each Uncontrollable inputs Sorted by least risk points being executed first 4.3 Define outputs Pretest predictions Analytical equations Noted assumptions, unknowns How to measure the outputs in test Notable stopping points increasing risk of damage to test vehicle or persons interacting with test vehicle limits of measuring equipment 4.4 Step-by-step procedure for each test point Equipment set up and calibration Test vehicle preparation Initial condition definition, set, measured Test point execution Outputs measured Outputs recorded Selection of next test point Pass/fail criteria defined 5 Outbrief 5.1 Percentage completion of test points New knowledge gained 5.3 Redesign required?

13 Discussion In your pairs or groups, identify one test that was proposed and develop the who, what, where, why and the success criteria

14 Test tips User testing and prototypes Component tests o Small parts that are demonstrated can help hold the team accountable Fit and form tests Simulate usage o Walked on the Martian surface Use Cases software o Build a case or example of how to use the design and see if it works correctly

15 Another example Testing in the proper conditions

16 DFMEA : Design for Robustness Pick one project from your group for this section

17 DFMEA Steps 1. Review the design 2. Brainstorm potential failure modes 3. List potential effects of failure 4. Rank failures a) Severity b) Occurrence c) Detection d) RPN = Severity X Occurrence X Detection 5. Develop action plan 6. Implement fixes 7. Revisit potential failure risks

18 DFMEA Matrix Failure mode Effect of Failure Severity Occurrence Detection Rating

19 Rate failures Rating (1 to 10) Severity Occurrence Detection How severe are the consequences to the failure How often are the failures likely to occur? How easily are the failures detected?

20 DFMEA Calculations Scores for Severity, Occurrence and Detection o 1 to 10 o 1 = Low o 10 = High Risk Priority Number (RPN) o RPN =Severity X Occurrence X Detection

21 Continue the process Implement the plan to eliminate the failure scenario Revisit other potential failure risks o Prioritize o Eliminate failure scenarios Continue until risks are below determined thresholds o Show to the design reviews for confirmation

22 Can we get rid of all failures? All cars have brakes that will eventually fail o Potentially catastrophic o Early warning squealers to notify

23 Questions/Discussion