inemi Statement of Work (SOW) NEMI Board Assembly TIG inemi Functional Test Coverage Assessment Project

Transcription

1 inemi Statement f Wrk (SOW) NEMI Bard Assembly TIG inemi Functinal Test Cverage Assessment Prject Versin # 1 Date Prject Leader: C-Prject Leader: TC Cach: Page 1 f 8

2 Basic Prject Infrmatin Purpse: The purpse f this prject is t create a functinal test cverage assessment methd that enables reliable cmparisn f test cverage between different test envirnments, between test revisins, and between different assessrs. Creating mre cnsistency in functinal test cverage assessment pens mre pprtunity t autmate r standardize reprts, enabling mre infrmed decisin making n issues pertaining t test. Backgrund and Mtivatin: Cverage reprts fr structural test equipment (e.g., ICT, AXI, AOI) are relatively standardized due t the cnsistency f the test envirnment. Fr example, testing a resistr n ne design is relatively the same as testing a resistr n anther, cmpletely different, design. Functinal test equipment is mre custmized, including the hardware, sftware and test generatin prcess. Due t this variability f the test envirnment, and the fact that functinal test requires the bard t perfrm its native functins during testing, determining whether a resistr value is crrect in tw differing designs is at least difficult, and culd be impssible. Frmulating a cverage assessment methd fr functinal test must encmpass the fact that the test envirnment differs, and yet still ffer infrmatin that allws the cverage f the test t be cmprehended, and cmpared t ther test stages r test revisins. Given bard size/density/speed cnstraints, btaining acceptable testpint access is becming mre challenging, placing an increasing burden n functinal test t cver defects that might nrmally have been detected at MDA/ICT given higher testpint access. Understanding hw functinal test can supplement upstream test stages becmes critical t implementing an end-t-end test plan. Examples f the cverage spectrum, referencing PCOLA/SOQ fr the structural test defect spectrum nmenclature, wuld lk smething like Figure 1. Functinal test additins used in this example include F=Feature Testing, A=At-Speed Testing, I=In Parallel Testing, M=Measurement. Page 2 f 8

3 Figure 1 Gaps in test cverage can be visualized as light shining thrugh gaps in cverage capability, as shwn in the AOI hypthetical cverage in Figure 2. Figure 2 Page 3 f 8

4 Using a cmmn defect spectrum and stacking multiple test stages, cverage frm all test stages can be cmpared, as shwn in Figure 3, with the resulting test gaps in the entire test prcess indicated n the bttm. AOI MDA/ICT FT Gaps Figure 3 The diagram abve is a graphical representatin that can als be depicted in a Venn diagram f the defect universe and three test stages in Figure 4, where the black areas in Figure 3 are areas f the defect universe that are cntained smewhere within the scpe f any test stage in Figure 4. Defect Universe AOI Cverage ICT Cverage FT Cverage Figure 4 This is but ne usage mdel fr a functinal test assessment methd that leverages upn, and adds t, a structural defect spectrum and assessment methd. Mre usefulness can be btained by intrducing cnfidence margin and weighting factrs t allw reprting f hw much yu trust the assessment (cnfidence margin), r reprting f hw imprtant cverage n that particular defect is (weighting factr). Page 4 f 8

5 Scpe f Wrk The effrt can be divided int three stages: Phase 1 Entry, prject acceptance. Exit, meet deliverable requirements and define Phase 2 entry requirements. Timeline, estimated t be mid Q2 07. Research usage mdels f functinal test cverage. Examples: Meeting quality requirements X% functinal test cverage f all blcks, Y% cverage f critical blcks, max-rated speed testing f all interfaces, etc. Cmparing test revisins Cmparing test envirnments t aid selectin f test HW/SW Cmparing test stages t determine test hles that must be caught at a later test stage Reusing test cverage assessments f design blcks that were reused Phase 2 Entry, as defined in Phase 1. Exit, meet deliverable requirements and define Phase 3 entry requirements. Timeline, estimated t be mid Q3 07. Create list f deliverables frm prject t supprt usage mdels. Suggested deliverables include: Cmpile a list f defects that encmpasses structural faults referencing existing categrizatin methds, i.e., PCOLA/SOQ, PPVS, MPS r IPC defect categrizatins. Add functinal test specific defects t structural defect list: Feature, an aggregate, f any r all, f silicn, circuitry and SW At-speed, testing full range f functinal speed frm lwest t highest In parallel, creating system stress by running tests in parallel Measurement, discrete measurement (vltage, current, db, etc.) r CRC, BERR, etc. Other ptential items: Diagnsability can the fault be deduced frm the errr Gauge f system stress Define assessment methds (e.g., paper assessment, assessment by bservatin, fault injectin) Create cnfidence margin and weighting factrs that allw emphasis fr imprtant assessment items Develp guidelines fr assessing cverage and assigning cnfidence margin Phase 3 Entry, as defined in Phase 2. Exit, meet deliverable requirements. Timeline, estimated t be end f 07. Use unified defect list, assessment methd, cnfidence margins, weighting factrs and guidelines t slidify cverage assessment details then ensure the methd fits the usage mdels Purpse f Prject Explain hw the prject aligns t the radmap and what gaps will be filled Will the prject prvide a cmplete slutin r be part f a cmplex slutin? List anticipated benefits t participants, t the inemi membership in general, and the industry Previus Related Wrk Review any related research r develpment dne within the industry Summarize, briefly, directly related academic research, if any Page 5 f 8

6 Participants List all participants and their managers. Strive t include representatives f all facets f the industry, including custmers, suppliers, and manufacturers. State rle and expected cntributins f each prject team member List any knwn backgrund IP fr each participant Prject Plan (Prject plan is being develped) Schedule with Milestnes Prject plan with identified tasks, intermediate check pints, and end dates A detailed timeline, including each prject activity and each scheduled prject review. Use the fllwing frmat: Phase 1 Task 1 Task 2 Task n Phase 2 Q1 Q2 Q3 Q4 Q5 Q6 Q7 Q8 TENTATIVE (18mnths) TENTATIVE (18mnths) TENTATIVE (18mnths) Phase 1 Detailed Infrmatin Task 1 Task n(include the fllwing infrmatin fr each task in a separate bullet list) Resurces A detailed list the resurces needed and expenditures expected fr the prject, including human resurces, mney, and equipment List f cmmitted resurces frm participating cmpanies State surce f funding fr any cmpnents, assembly, design, and testing needs. Alternatives include participant dnatin, inemi direct funding, and supplier dnatin. Materials and Prcesses Identify the materials t be used. Standard materials shuld be used whenever pssible. Use f standard materials reduces csts, imprves yields, and assures the widest applicability f results within the industry. Justificatin shuld be prvided if nn-standard materials are t be used. Describe any prcesses t be used, including applicable standards and specificatins. Use f standard prcesses reduces csts, imprves yields, and assures the widest applicability f results within the industry. Use f any nn-standard prcesses must be justified. Any specific suppliers r technlgies required and reasns fr the requirement In cases where custm cmpnents are necessary, state which prject participant is respnsible fr assuming this cst Testing Prcedures Page 6 f 8

7 State anticipated number f parts t be tested. Use discriminatin in chsing samples fr failure analysis t maximize ROI. Use IPC C as baseline ATC unless justificatin can be given fr alternate test parameters Fr test vehicle design and fabricatin, it is recmmended that reference cmpnents that have been ATC tested n previus prjects be used t prvide a baseline and facilitate cmparisn f results between prjects. Explain design prtcl. Use standard design practices and cmmnly used sftware t reduce csts and widen applicability f results. At what stages testing will be dne and time needed Phase 2 Detailed Infrmatin Task 1 Task n (include the fllwing infrmatin fr each task in a separate bullet list) Resurces A detailed list the resurces needed and expenditures expected fr the prject, including human resurces, mney, and equipment List f cmmitted resurces frm participating cmpanies State surce f funding fr any cmpnents, assembly, design, and testing needs. Alternatives include participant dnatin, inemi direct funding, and supplier dnatin. Materials and Prcesses Identify the materials t be used. Standard materials shuld be used whenever pssible. Use f standard materials reduces csts, imprves yields, and assures the widest applicability f results within the industry. Justificatin shuld be prvided if nn-standard materials are t be used. Describe any prcesses t be used, including applicable standards and specificatins. Use f standard prcesses reduces csts, imprves yields, and assures the widest applicability f results within the industry. Use f any nn-standard prcesses must be justified. Any specific suppliers r technlgies required and reasns fr the requirement In cases where custm cmpnents are necessary, state which prject participant is respnsible fr assuming this cst Testing Prcedures State anticipated number f parts t be tested. Use discriminatin in chsing samples fr failure analysis t maximize ROI. Use IPC C as baseline ATC unless justificatin can be given fr alternate test parameters Fr test vehicle design and fabricatin, it is recmmended that reference cmpnents that have been ATC tested n previus prjects be used t prvide a baseline and facilitate cmparisn f results between prjects. Explain design prtcl. Use standard design practices and cmmnly used sftware t reduce csts and widen applicability f results. At what stages testing will be dne and time needed Prject mnitring plans Hw will yu ensure pen lines f cmmunicatin amng participants? Cnference call every? weeks Page 7 f 8

8 Frm sub-teams t enable lcalized cmmunicatin f sub-team details Offline Face-t-face meetings twice per year Planned telecnference schedule Every? weeks Request prgress reprts as tasks are cmpleted Upn sub-team task clsure Dates f technical reviews (2 per year) and prgress reprts and what they will cntain Practice risk analysis by anticipating prblems and having alternate slutins ready Use pprtunity analysis t identify new areas r tpics that might be addressed in additinal prjects. This will prevent the scpe f the current prject frm expanding and keep the prject fcused n riginal gals Review prject requirements with suppliers befre the prject begins Outcme f the prject Define prject success, including what gaps will be clsed Pending Phase 2 definitin List all deliverables Pending Phase 2 definitin State which prject results will be shared, with whm, and by what means NOTE: All changes t SOW must be apprved by the TC (versin cntrl) Page 8 f 8