AEP Ohio IN-HOME ENERGY PROGRAM Scoring Methodology for QAQC Scoring System Version 1.1 2/3/15

Transcription

1 AEP Ohio IN-HOME ENERGY PROGRAM Scoring Methodology for QAQC Scoring System Version. /3/5 99 Eastwind Drive, Suite 5 Westerville, OH

2 Table of Contents.0 Job Score Components 3. Work Quality Score 3. Customer Service Score 5.3 Data/Documentation Quality Score 5.4 Program Metrics Error! Bookmark not defined..0 Component Weighting Calculation of Job Score Calculation of the Contractor Grade 0 Exhibit I: Energy Efficiency Measures Exhibit II: Customer Service Elements 3 Exhibit III: Data/Doc Quality Elements 4 Scoring Methodology AEP Ohio In-home Energy Program /3/5 Page of 4

3 .0 JOB SCORE COMPONENTS. Work Quality Score The quality of work is the most important component of the scoring system as it is paramount to achieving predicted energy savings, has a large impact on AEP Ohio customer satisfaction, and is integral to a positive evaluation of the overall program. Quality of work is established through a quality assurance site inspection by a trained CSG QA inspector. The Work Quality score is derived in three steps:. Establish the total number of available points at a given job. A job may consist of one or more Energy Efficiency Mesaures (EEMs);. Assign the number of points that the installing contractor has earned based on the completeness and quality of the work; and 3. Calculate a normalized Work Quality score by dividing the earned points by the available points and then applying a modifier if a return visit is required. The details of the steps are as follows:.. Establish the total number of available points at a given job Point values are assigned to all tasks within each EEM (See Exhibit I: Energy Efficiency Measures). The point system weights tasks by assigning more points to tasks that are considered more important to an EEM. Task weighting was determined using the professional judgment of the CSG Quality Control Manager and consultation with peers. However, some tasks are not applicable at certain jobs and some tasks cannot be inspected because of site conditions. The point values for these tasks are also not counted toward the total available points for the job. Therefore, the total available points for the job is equal to the sum of the assigned points for all applicable and inspected tasks on the job. This number defines a perfect score for the job... Assign the number of points that the installing contractor has earned based on the completeness and quality of the work At each inspection, the CSG QA inspector will evaluate the EEMs and associated tasks that were performed at that site. Every task will be rated by the inspector on a six-choice scale, with each rating determining a multiplier to be applied to the total available points for that task. The following table provides scores, descriptions, and multipliers. Scoring Methodology AEP Ohio In-home Energy Program /3/5 Page 3 of 4

4 EEM Ratings Rating Description Multiplier Compliant Work was performed correctly..0 Partially Compliant Work was performed but minor issues were found that 0.67 should be communicated to the contractor. Most are correctable by inspector, or may require a return visit by the contractor. Non-Compliant Work was performed poorly or was not performed. Return 0 visit or billing adjustment almost always required. In some circumstances, inspector may be able to correct issue. Emergency The worksite was left in a dangerous condition requiring 0 immediate action to safeguard the occupants or structure. There does not need to be an emergency actually occurring at the time of the inspection; rather, the conditions must have created the potential for an emergency to occur. Not Inspected Work that could not be inspected due to site conditions and None therefore is not included in point calculations. Not Applicable This task was not applicable to the site, and therefore is not included in the point calculations None An Emergency rating will create an overriding score of zero for the Job Score, and, if the contractor is in the Active status (regardless of their contractor grade), will move the contractor in the Probation status...3 Calculate a normalized Work Quality score by dividing the earned points by the available points and then applying a modifier if a return visit is required. The Work Quality score will be calculated by dividing the sum of the earned points by the total available points. The resulting 'percentage achieved' is then multiplied by 0 to normalize the score on a 0 point scale. That score will then be multiplied by a modifier of either, if a return visit is not needed, or 0.67 if a return visit is needed and it has been determined that the contractor is at-fault. A return may be considered a no fault under the following circumstances: When a return would not be required by program but needed due to a customer request; When there is inconclusive evidence as to whether contractor or Homeowner caused damage/issue When program rules have changed such that a return is now required for previously approved practices No points are deducted for a no fault return. Scoring Methodology AEP Ohio In-home Energy Program /3/5 Page 4 of 4

5 . Customer Service Score Customer service by the contractor is a high priority for CSG clients as it often impacts the overall program impression for the customer. While there are various means of gauging customer satisfaction with various aspects of a program, AEP Ohio customer satisfaction with a contractor s work will be measured through a short list of questions posed by the CSG QA inspector at the time of the inspection. This approach is being taken to insure that there is customer service data for each job inspected. The Customer Service scores is derived in two steps:. Assign the number of points that the installing contractor has earned based on seven elements of customer service; and. Calculate a normalized Customer Service score as a function of the individual customer service element scores. The details of the steps are as follows:.. Assign the number of points that the installing contractor has earned. Each customer service element (see Exhibit II: Customer Service Elements) will be rated by the customer on a five-choice scale, with each rating determining a multiplier to be applied to the total available points for that element. The following table provides scores, descriptions, and multipliers. Customer Service Ratings Rating Description Multiplier Excellent Contractor exceeded the expected level of service.00 Good Contractor met the expected level of service 0.67 Fair Contractor failed to meet the expected level of service 0.33 Poor Contractor provided an unacceptable level of service 0.00 No Opinion Intended to reflect that Customer could not or would not give score; defaults to a Good value The No Opinion score was created for those jobs where the person present for the inspection is not able to give a customer service score for one or more aspects of the survey. This is done with the understanding that it would be valuable to track these instances, but not penalize the contractor for the absence of a score... Calculate a normalized Customer Service score as a function of the individual customer service element scores The customer service score will be calculated by dividing the sum of the earned points of the survey by the sum of the total available points. The resulting 'percentage achieved' is then multiplied by 0 to normalize the score on a 0 point scale..3 Data/Documentation Quality Score Scoring Methodology AEP Ohio In-home Energy Program /3/5 Page 5 of 4

6 The completeness and accuracy of the documentation submitted as part of the rebate application directly impacts the speed with which CSG can process the applications, which directly impacts invoicing and reporting on jobs to the utility client. Incomplete and/or inaccurate documentation delays the resolution of incentive applications and can result in the wrong incentive being paid and improper savings reported, all of which impact the overall integrity of the program. When the rebate application package is received, it is rated based on three categories to complete the Data/Documentation Quality score:. Timeliness. Completeness 3. Discrepancies The Data/Documentation Quality score will reflect how well the contractor is actually completing the work as specified and documenting any conditions or changes that are made to the site. The Data/Documentation Quality score is derived in four steps:. Establish the total number of available points for Timeliness, Completeness, and Discrepancies for any given rebate application package;. Assign the number of points that the rebate application package has earned for Timeliness, Completeness, and Discrepancies; 3. Calculate normalized scores for Timeliness, Completeness, and Discrepancies; and 4. Calculate a normalized Data/Documentation Quality score by weighting and then combining the Timeliness, Completeness, and Discrepancies scores. The details of the steps are as follows:.3. Establish the total number of available points for Timeliness, Completeness, and Discrepancies for any given submission Data/Document Element: this could be classified as a document, an entire EM Home submission, or some defined sub-set of an EM Home submission (e.g. all Recommendations is one unit, all blower door information is another unit, etc). This classification is program specific and in Exhibit III: Data/Doc Quality Elements. Timeliness Timeliness is rated for the entire rebate package, so its total available points stay constant (See Exhibit III: Data/Doc Quality Elements). Completeness A maximum number of available points for Completeness is equal to the sum of the points assigned to all applicable data/doc elements (See Exhibit III: Data/Doc Quality Elements). The master list of data/doc elements includes all possible elements that could be required as part of a rebate application package. Scoring Methodology AEP Ohio In-home Energy Program /3/5 Page 6 of 4

7 However, some data/doc elements are not applicable for certain jobs. The point values for these data/doc elements are not counted toward the total available points for Completeness. Therefore, the total available points for Completeness is equal to the sum of the assigned points for all applicable data/doc elements. This number defines a perfect score for Completeness. The point system can assign higher point values for data/doc elements that are considered more important to an application. Currently, the program is weighting all data/doc elements equally. Discrepancies Discrepancies are rated for the entire rebate application package, and are always comprised of two tasks: ) discrepancies between the data/doc elements; and ) discrepancies between site conditions and data/doc elements..3. Assign the number of points that the rebate application package has earned for Timeliness, Completeness, and Discrepancies After completing the work, the contractor will submit to CSG the rebate application package for rating. Timeliness The CSG administrative staff person will rate whether the entire package is submitted whole and on time on a two category scale: Compliant or Non-Compliant. Each rating will determine a multiplier to be applied to the total available points for Timeliness. Timeliness Rating Description Multiplier Compliant All applicable data/doc elements were submitted within 4 calendar days.0 from the job completion date and together in one initial submittal Non- Compliant A single submittal with all applicable data/doc elements was not received within 4 calendar days from job completion. This includes any case in which multiple incomplete (i.e. not containing all applicable elements) submittals were sent, even if when combined all were received before the 4 day deadline. 0 Completeness The CSG administrative staff person will rate whether each data/doc element is complete based upon a four category scale. Each rating will determine a multiplier to be applied to the assigned points for each document. Completeness Rating Description Multiplier Compliant All data fields in data/doc element were completed and contain reasonable entries (i.e. not necessarily correct, but plausible).0 Scoring Methodology AEP Ohio In-home Energy Program /3/5 Page 7 of 4

8 Not Applicable One or more data fields in data/doc element were either not completed or contain an unreasonable entry (e.g. phone number on CFM50 field) This data/doc element was not submitted in the initial package and therefore is entirely incomplete This data/doc element was not applicable to the data/documentation score, and therefore not included in the valuation 0 0 N/A The program may find it useful to utilize more granular ratings for document Completeness than the current Compliant and Non-Compliant options. If so, they may create new program-specific definitions that utilize Good, Fair, Poor, and Non-Compliant. The table above will be updated with any new definitions. The definitions for Missing and Not Applicable will always remain the same. Discrepancies There are two tasks for Discrepancies:. CSG Admin rates whether there are any discrepancies between the data/doc elements.. CSG QA inspector rates whether there are any discrepancies between the submitted data/doc elements and site conditions. The ratings will be on a four category scale. Each rating will determine a multiplier to be applied to the total assigned points for that task. Non- Compliant Missing Task : Discrepancies Between Data/Doc Elements Rating Description Multiplier Good Admin can process the job with submitted data/doc elements.0 Fair Admin must do some additional work or make corrections but can 0.67 process based on their knowledge alone Poor Contractor needs to submit/provide additional data to process 0.33 Non- Compliant Flaw(s) is/are serious enough to deny payment 0 Task : Discrepancies Between Data/Doc Elements & Site Conditions Rating Description Multiplier Compliant No discrepancies exist between data/doc elements and site conditions.0 Non- Compliant At least one discrepancy exists between data/doc elements and site conditions For Task #: Discrepancies between Data/Doc Elements & Site Conditions, a discrepancy is defined as follows: A discrepancy needs to pertain to a measure that was billed/invoiced and the contractor must have not attempted the work in question. Conversely, if the contractor attempted to install a billed/invoiced measure but did it poorly, that would NOT be a discrepancy. 0 Scoring Methodology AEP Ohio In-home Energy Program /3/5 Page 8 of 4

9 For example: If the contractor claimed they insulated 3 attic hatches but only were insulated, that would be a discrepancy because they actually did not attempt one of them but it was billed for. It would also get be Non-Compliant for the specific task because properly insulating the attic hatches requires doing all of them. If they missed insulating an entire section of the attic that was listed on their paperwork, that also would be a discrepancy because they didn t attempt it. It would also be Non-Compliant for the appropriate tasks because by not insulating it, they left gaps, voids, etc. o But if they only did 4 of insulation when they should have done 6 that would just be Non-Compliant, and not a discrepancy. They attempted it but did it poorly. Another case is when the contractor reports a passing worst case draft test but our inspector finds it fails. In this case that would not be a discrepancy, because ) it s not pertaining to a billed/invoiced measure and ) we can t really tell if they did or didn t attempt to fix it originally..3.3 Calculate a normalized score for Timeliness, Completeness, and Discrepancies The score for each of the three categories will be calculated by dividing the sum of the earned points in each category by the total available points for the category. The resulting 'percentage achieved' is then multiplied by ten to normalize the score on a ten point scale. This results in a normalized score for each category: Timeliness, Completeness, and Discrepancies..3.4 Calculate a normalized Data/Documentation Quality score by weighting and then combining the Timeliness, Completeness, and Discrepancies scores. Each of the normalized scores will be multiplied by their weight and summed together for a final Data/Documentation Quality score normalized on a ten point scale. The weights are as follows: Documentation Quality Category Weights Category Timeliness 0.75 Completeness 0.75 Discrepancies 0.65 Total.0 Weight.0 COMPONENT WEIGHTING The component weighting supports the overall program goals as set by the Client, in that it allows a Client to set preferences for relative importance of work quality vs. customer service quality. The Component Weighting criteria are set prior to the rollout of the program through consultation with the Client. Scoring Methodology AEP Ohio In-home Energy Program /3/5 Page 9 of 4

10 The weighting for the Job Score components is as follows: Job Score Component Weights Component Work Quality 0.60 Customer Service 0.5 Data / Doc Quality 0.5 Total.0 Weight 3.0 CALCULATION OF JOB SCORE The Job Score is a reflection of the three individual component scores and the preferred weighting of the client, resulting in a Job Score represented by normalized number on a scale of 0 0. Each component of the Job is multiplied by the component weighting, and the resulting three products summed to comprise the Job Score. 4.0 CALCULATION OF THE CONTRACTOR GRADE The calculation of the contractor grade is determined by summing all of the contractor s Job Scores over a prior period and dividing the sum by the number of jobs completed by the contractor in that same period. Thus it is an average of the Job Scores. The contractor grade is one of the components used to determine the contractor status which by extension determines whether a contractor is eligible to participate, receive any benefits or preferences through the program, and ultimately remain in the program. See the program s Participation Agreement and/or Quality Assurance/Quality Control plan for a description of each status. The Program will calculate the Contractor Grade on a monthly basis. Grades will encompass the previous three months of scores or the previous 5 jobs, whichever is more. If the contractor has not completed five jobs in the 3 month reporting period, then the period will be extended backward until the day when the 5 job quota was met. Scoring Methodology AEP Ohio In-home Energy Program /3/5 Page 0 of 4

11 Exhibit I: Energy Efficiency Measures Note: Tasks eligible for the Emergency rating are highlighted in red with the symbol (E!). Return Time and Home Owner Follow Up only specified for Emergencies. All other tasks require return time as specified in the QAQC procedures for non-emergency issues..0 KNOB & TUBE WIRING Knob and Tube Wiring is not a scored item, however it should be dealt with as follows if discovered: Knob & Tube Wiring Task Description Pts Return Home Owner Follow Up If there is knob and tube wiring covered by insulation, the inspector should ask for the letter from the electrician certifying that it is deactivated. If there is no letter, then it is an Emergency. Knob and Tube Wiring (E!).0 DIRECT INSTALL MEASURES N/A ASAP Inform the Homeowner that this type of wiring should not be insulated over and that an electrician should have examined and signed off that the wiring is inactive before work proceeded. Either the contractor or electrician shall be made to return immediately. Bathroom Faucet Aerator Task Description Pts. Customer permission was gained prior to install Any measure that is visible or used by a customer should have been approved by the customer before installation. If customer cannot remember whether they were asked or were not present during the installation, rate this as Not Inspected.. Aerator is leak free Self explanatory Kitchen Sink Aerator Task Description Pts. Customer permission was gained prior to install Any measure that is visible or used by a customer should have been approved by the customer before installation. If customer cannot remember whether they were asked or were not present during the installation, rate this as Not Inspected.. Aerator is leak free with The aerator should still be leak free when the flip restricts flip closed flow and the water pressure is increased. 3. Customer was shown how to use flip The customer should have been shown how the flip works and given a few suggestions as to when using it would save hot water or just water. Scoring Methodology AEP Ohio In-home Energy Program /3/5 Page of 4

12 High Efficiency Showerhead Task Description Pts. Customer permission was gained prior to install Any measure that is visible or used by a customer should have been approved by the customer before installation. If customer cannot remember whether they were asked or were not present during the installation, rate this as Not Inspected.. Showerhead is leak free Self explanatory 3. Water stream even The stream should not exit at an angle from the shower head, there should not be any single streams shooting away from the main flow and the stream should be close to symmetric. Compact Fluorescent Light Bulbs Task Description Pts. Customer permission was gained prior to install Any measure that is visible or used by a customer should have been approved by the customer before installation. If customer cannot remember whether they were asked or were not present during the installation, rate this as Not Inspected.. Location and is an eligible area 3. Bulb and location compatible Program standards will have a minimum run time for existing bulbs that can be replaced under the program. (Note: If program has no such requirements, grade as N/A.) Unlike incandescent bulbs CFLs must be matched to their location to perform properly. Exterior bulbs should be exterior rated and only dimmable bulbs in fixtures with dimmers. Night Lights Task Description Pts. Customer permission was gained prior to install Any measure that is visible or used by a customer should have been approved by the customer before installation. If customer cannot remember whether they were asked or were not present during the installation, rate this as Not Inspected.. Night light works The bulb energizes and comes to its full brightness. Scoring Methodology AEP Ohio In-home Energy Program /3/5 Page of 4

13 Programmable Thermostats Task Description Pts. Customer permission was gained prior to install Any measure that is visible or used by a customer should have been approved by the customer before installation. If customer cannot remember whether they were asked or were not present during the installation, rate this as Not Inspected.. Thermostat is programmed for setback 3. Programming instructions left with the Homeowner 4. Installer showed Homeowner how to set the thermostat 5. Equipment cycles in the correct sequence The installed thermostat has been programmed and is running on the program. If it is not running on the program, the inspector should ask the customer whether they turned it off. If customer cannot remember whether they or someone else turned it off, rate this as Not Inspected. The booklet with programming instructions (not installation instructions) left with Homeowner. Verbally verify with the Homeowner that the installer showed them how to program the thermostat. If customer was not present during the installation, rate this as Not Inspected. When equipment is turned on in heating mode, the inducer fan or power vent should turn on first, followed by the heat exchanger and finally blower fan. Scoring Methodology AEP Ohio In-home Energy Program /3/5 Page 3 of 4

14 3.0 SHELL MEASURES Attic Air Sealing Task Description Pts Return Home Owner Follow Up. Top Plates This refers to all interior and exterior wall Sealed plates.. Knee Wall Transition Bypass Sealed Specific to the floor joist transition where an unfinished floor area meets a finished space at a kneewall. 3. Plumbing Wet Wall(s) Sealed 4. Chimney Penetration(s) Sealed (E!) 5. Recessed Lights Covered/Sealed (E!) This includes not only the vent penetration but the wall plate or opening itself which may be a sizable gap requiring an approved backer. This can include masonry chimneys or metal flues. Fire proof materials must be used here. This task can receive a Partially Compliant or a Non-Compliant score if fire proof materials are installed, but the quality of the work is either poor (non-compliant) or could be improved by an FYI (partially compliant). Receives an Emergency if NON-fireproof materials were installed. This would also refer to covering material (tops and sides) and clearance from the fixture. This task can receive a Partially Compliant or a Non-Compliant score if the correct materials are used and the specified clearances are maintained, but the quality of the installation is poor (non-compliant) or could be improved by an FYI (partially compliant). Receives an Emergency if correct materials are NOT used or specified clearances are NOT maintained. 6. Attic Access(s) This could include the insulated attic access Sealed cover. 7. Drop Soffit Approved material used and sufficiently Area(s) Sealed supported. 8. Mechanical Includes AC/heating boots Chase(s) Sealed 9. Attic Level This refers to sealing the open wall bays Transitions where top plates should be when an attic Sealed transitions from one level to another. 0. Bath Fans Self explanatory. ASAP Inform the Homeowner that the chimney/flue clearance to combustibles does not meet program standards and will need to be adjusted. 48 Hrs Inform Homeowner that recessed lights clearances to combustibles does not meet program standards and will need to be adjusted. The Homeowner should be made to understand that the recessed lights are not to be used until the situation is addressed. Scoring Methodology AEP Ohio In-home Energy Program /3/5 Page 4 of 4

15 Sealed. Air Barrier (e.g. Rigid Board) Properly Installed Over Open Cavities Air barrier must be consistent no gaps and sealed seams and edges. Attic Insulation Task Description Pts Return Home Owner Follow Up. Presence of Continuous Air Barrier Verified Prior to Insulating If there were any problems found in the air sealing inspection, then the air barrier is not continuous and therefore the contractor did not verify it prior to insulating.. Specified R- Value Installed 3. Insulation Quality: No Gaps, Voids, or Compression (includes non- Densepack enclosed cavities) 4. Heat Sources Dammed (E!) 5. Mechanical Systems Dammed Correct depth installed, as measured by the difference between final and pre-existing depth and matches what is specified on the work order. All applicable areas insulated. Blown insulation must be level. Batt insulation must be installed across joists with no air space between layers. Enclosed spaces must be filled. Square footage of installed insulation matches what was specified to within +/- 0%. Includes recessed lights, fan/light combos, heaters, chimneys, flue pipes, kitchen exhaust ducts. Heat sources are singled out for damming in this task because they are a potential fire hazard. This task could receive a Partially Compliant or Non-Compliant score if the correct materials were used and the specified clearances were maintained, but the dam itself does not perform the task it was installed for. This may include not extending far enough above the blown insulation to serve as an effective dam or not be secured or fastened well enough to remain in place for its expected life years. Receives an Emergency if fireproof materials were NOT installed. Includes bath fans, drip pans, whole house fans, etc. Varies If heat source can be made temporarily safe by not using it, inform the Homeowner to not use it and have the contractor return to fix it within 48 hrs. If it is the type that cannot be shut off then the contractor shall return ASAP to fix it. Scoring Methodology AEP Ohio In-home Energy Program /3/5 Page 5 of 4

16 6. Access Treated as Specified 7. Wind Baffles Installed 8. Vent Chutes Properly Installed 9. Storage Area Dammed and Clean 0. Exhaust Fans Vented as Specified. Attic Venting Installed as Specified. Densepack: Installed Material is Densepacked 3. Densepack: IR Scan/Blower Door Detects No Air Leakage Paths 4. Site Restored to Original Condition Access insulated. Bottom of the vent chute blocked properly with an air impervious barrier to prevent wind wash and insulation spillage. Also known as propavents, they maintain an air passageway from the soffit up the roof slope. Self explanatory. Bathroom vent fans connected with an insulated hose to an approved termination outside of the attic. Correct amount installed and was installed properly (i.e. no leaks, no straddling rafters, etc.). Self explanatory. This would indicate if a full cavity was properly densepacked loose filled cavities would reveal air leakage path ways. See applicable appendix in the program s Material & Installation Standards for IR scan procedures. No messes left behind, do doors and hatches were closed properly, storage square footage was maintained. Wall Insulation Task Description Pts. Specified R-Value Installed in Open Cavities Self-explanatory.. IR Scan Detects No Gaps, Self explanatory. See the applicable M&I Appendix for IR Voids, or Compression scan procedures. Square footage of installed insulation 3. Densepack: IR Scan/Blower Door Detects No Air Leakage Paths matches what was specified to within +/- 0%. This would indicate if a full cavity was properly densepacked loose filled walls would reveal air leakage path ways. See applicable appendix in the program s Material & Installation Standards for IR scan procedures. 4. Drill Holes Patched Properly Plugged and one layer of spackle. This is for interior Drill and Blow. 5. Drainage Plane Repaired Tyvek, EPS, or tar paper layer repaired so it sheds water shingle style. 6. Cladding/Sheathing Siding was replaced properly. Scoring Methodology AEP Ohio In-home Energy Program /3/5 Page 6 of 4

17 Properly Repaired 7. Site Restored to Original Condition No messes, damaged landscaping, poor touch-up paint, etc. Basement/Crawlspace Air Sealing (Incl. Frame Floor Over Ambient) Task Description Pts Return Home Owner Follow Up. Plumbing Self explanatory. Penetrations Sealed. Wiring Self explanatory. Penetrations Sealed 3. Chimney Chases Sealed (E!) Must use fire proof materials and methods. ASAP 4. Mechanical Chases Sealed 5. Rim and Band Joist Sealed 6. Basement Access Sealed 7. Ground Cover Installed and Sealed 8. Windows Caulked or Foamed 9. Air Barrier Properly Installed on Underside of Floor Framing This task could be Partially Compliant or Non- Complaint if the correct materials were used, but the workmanship was too poor for the task to perform its intended function. This task could be a CP if the materials are correct, It performs its function, but the workmanship could be improved by an FYI to the installer. Receives an Emergency if fireproof materials were NOT installed. Approved material adequately fastened. Just like the attic this can include heating and cooling boots. This would include open balloon framing. Depending on where the thermal boundary is set, this may be from exterior to basement or from basement to living space. Vapor barriers over dirt floors. Depending on where the thermal barrier is set. If the basement is considered conditioned, then the windows should be made tighter if possible. If Tyvek or rigid insulation is specified. This would be a likely specification in vented crawls or floors over outdoors.. Inform Homeowner that clearances to combustibles does not meet program standards and that it will need to be adjusted. Scoring Methodology AEP Ohio In-home Energy Program /3/5 Page 7 of 4

18 Living Space Air Sealing (Garage Wall Mandatory) Task Description Pts. Baseboards Caulked Any measure that is visible or used by a customer should have been approved by with the customer before installation. If customer cannot remember whether they were asked or were not present during the installation, rate this as Not Inspected.. Window and Door Trim Caulked 3. Plumbing Penetrations Sealed 4. Boots Sealed to Interior Material 5. Interior Sheathing Voids Repaired 6. Ext. Doors Swept and Weatherstripped 7. Doors to Attached Garage Weatherstripped 8. Windows Weather Stripped Any measure that is visible or used by a customer should be cleared with the customer before installation. If customer cannot remember whether they were asked or were not present during the installation, rate this as Not Inspected. These openings around plumbing pipes can be sizable and even on interior walls are connected to interstitial or unconditioned spaces. The register should be removed and the boot sealed to the surrounding air barrier. This can be done as either air sealing or duct sealing, but should be scored in only one category. Use a compatible material that can be finished by the Homeowner. Q-lon with backer or approved material. Q-lon with backer or approved material. Verify the surfaces claimed as sealed were treated and that the window still operates correctly. Scoring Methodology AEP Ohio In-home Energy Program /3/5 Page 8 of 4

19 Duct Sealing Task Description Pts. Approved Material Used as Sealant Duct mastic or mastic backed tape.. All Field Seams Sealed Nickel thick layer of mastic around the entire seam or mastic backed tape. 3. All Manufacture s Seams Nickel thick layer of mastic around the entire seam or Sealed mastic backed tape 4. Filter Slot Treated Some type of gasketed door or panel that is permanent. Not just a piece of duct tape. 5. Boots Sealed to Interior See #4 immediately above. Material 6. Air Handler Sealed The cabinet s non-opening panels sealed with 00% silicone caulk. Removable panels for servicing sealed with duct tape (not mastic backed tape.) Duct Insulating Task Description Pts. Correct R-Value Installed Self-explanatory.. Insulation Snug, Not Insulation should not sag, but should not be pulled so Compressed tight it is compressed, which reduces R-value. 3. Seams Stapled Securely Excess material should be left when the insulation is cut. This excess should be folded neatly at the seams to hide the fiberglass and complete the vapor barrier. The seams should be stapled every with a cinch stapler. 4. Vapor Retarder Continuous 5. Vapor Retarder Sealed w/ Duct Tape Once the seams are folded and stapled securely the seam should be sealed with vinyl tape to complete the vapor barrier. This is especially crucial with AC. Self explanatory. Scoring Methodology AEP Ohio In-home Energy Program /3/5 Page 9 of 4

20 4.0 COMBUSTION APPLIANCE TESTING Visual Inspection Task Description Pts Return Home Owner Follow Up. Correct Fuel Correct test performed for fuel type. Identified. Located All CAZ All equipment was tested, and the depressurization set up accurately defined the CAZ. In homes with multiple CAZ, all were located and tested. 3. Correct Venting Type Identified This will come from their test results form or EM Home submission but also from whether or not they drilled holes or got test results. They must have also performed the correct tests based on the type of 4. Identified Any CAZ or Appliance Related Safety Issues (E!) venting system. Issues include detached or corroded flue pipes or problems with size or pitch, problems with DHW relief valve, broken or kinked oil lines, water leakage, open returns, no air filter, etc. Contractor should have corrected any issues. All of these issues can be either Non-Compliant or an Emergency. They are Non-Compliant if they exist, but the house is not imminent danger of explosion or fire and the ambient CO is not elevated due to the problem. ASAP/48 Hrs This is a broad category. If the situation places the Homeowner in immediate danger (elevated CO or gas levels) they should be asked to evacuate and the contractor shall return immediately. Otherwise, the Homeowner should be informed that the task does not meet program standards and that the contractor will return within 48 hrs to adjust. Specific guidance can be offered depending on the situation. Testing Inspection Task Description Pts Return Home Owner Follow Up. All Significant Gas Leaks Were Contractor s gas leak results must match inspector s. ASAP Each program should follow their client s procedures for Detected & this emergency. Repaired (E!) Any gas leak that can be verified with a soapy solution should be considered an Emergency.. Correctly Measured CAZ(s) Depressurization Contractor s results must match inspector s. Includes proper set up of exhaust appliances and doors. 4 Hrs Inform the Homeowner that the combustion testing has revealed a situation that does not meet program standards Scoring Methodology AEP Ohio In-home Energy Program /3/5 Page 0 of 4

21 (E!) 3. Spillage Assessment Correct (E!) 4. Draft Measurements Correct (E!) 5. Ambient CO Measurements Correct (E!) 6. Appliance CO Measurements Correct (E!) If the CAZ fails the depressurization limit, but the appliances still pass spillage and draft under worst case this is Non-Compliant. If the CAZ fails the depressurization limit, and under natural conditions the appliances fail spillage or draft, it is an Emergency. Contractor s results must match inspector s. Spillage is occurring under worst case conditions, but not causing unsafe levels of CO would be Non- Compliant. Spillage occurring at worst case that does cause unsafe levels of CO or any spillage that occurs under natural conditions should be considered an Emergency. Contractor s results must match inspector s. Includes test hole drilled in correct location. Failure of the draft test under natural conditions or failure at worst case that is causing spillage and unsafe levels of CO is an Emergency. Failure at worst case that is not spilling is non-compliant. Contractor s results must match inspector s. Ambient CO that exceeds 35 ppm under any circumstances is an Emergency. Ambient CO that exceeds 9 ppm (OSHA 8 hour exposure limit) under non-testing conditions is an Emergency. Contractor s results must match inspector s. Includes number of results. and that the contractor will need to return to adjust. If possible make temporary adjustments to the CAZ to provide pressure relief and instruct the Homeowner not to undo the temporary fix. 4 Hrs See # above. If pressure relief to the CAZ does not stop spillage, the appliance should be turned off and the contractor shall return immediately. 4 Hrs See # above. If pressure relief to the CAZ does not stop spillage, the appliance should be turned off and the contractor shall return immediately. ASAP ASAP If CO exceeds 35 ppm during testing, inform Homeowner that house is temporarily unsafe and recommend leaving until ambient CO level returns to safe levels. If baseline CO is more than 9 ppm but less than 35, inform Homeowner that house is not safe to be in for long periods of time and recommend that they have the system evaluated by a BPI certified HVAC contractor. Inform Homeowner that appliance is producing unsafe levels of CO and not venting Scoring Methodology AEP Ohio In-home Energy Program /3/5 Page of 4

22 7. Test Results Interpreted Correctly Appliance CO measurements should only be considered an Emergency if they are combined with either spillage or draft test failures at natural conditions. Otherwise, it should be considered Non- Compliant and the Action Levels Table referred to. Contractor's actions must be consistent with BPI s Combustion Safety Test Action Levels Table based on the results of their combustion testing. 3 properly. Recommend turning off appliance and having it evaluated by a BPI certified HVAC contractor. 5.0 HEATING SYSTEM MEASURES Heating System Replacement Task Description Pts General. Installed System is as Specified Verify make and model number of installed system.. Flue Liner Installed as Self Explanatory Specified by Manufacturer. Natural Draft Flue Slopes Self Explanatory. at ¼ per Ft 3. Natural Draft Venting has 3 for b-vent and 6 for single wall. Proper Clearance to Combustibles 4. No Gas Leaks at New Gas Self Explanatory. Line Connections or Appliance 5. No Supply Registers Installed in Plenums Self Explanatory. Big openings in supply plenums reduces the pressure and overall performance of an entire system. Returns in CAZ can cause de-pressurization and back drafting problems (and flame rollout). 6. No Returns Installed in CAZ 7. Air Handler Sealed The cabinet s non-opening panels sealed with 00% silicone caulk or duct mastic. Removable panels for servicing sealed with duct tape (not mastic backed tape). 8. Approved Material Used Duct mastic on ducts, 00% silicone used on non-service As Sealant to Ducts openings of air handler, and duct tape on service doors. 9. Delta T Temperature Rise Contractor s results must match inspector s. 0. Combustion Efficiency Contractor s results must match inspector s. 3 Scoring Methodology AEP Ohio In-home Energy Program /3/5 Page of 4

23 Exhibit II: Customer Service Elements Customer Service Elements Category Points. Scheduling. Promptness 3. Politeness 4. Communication 5. Organization & Cleanliness 6. Knowledge 7. Overall 3 Scoring Methodology AEP Ohio In-home Energy Program /3/5 Page 3 of 4

24 Exhibit III: Data/Doc Quality Elements Timeliness Element Points. Entire Rebate Application Package Completeness Element Points. Invoice. Worst Case Draft Testing 3. Manual J Heat/Cool Load Calcs 4. Building Tightness Disclaimer 5. Combustion Safety Disclaimer Discrepancies Task. Discrepancies between Data/Doc Elements. Discrepancies between Data/Doc Elements & Site Conditions Points Scoring Methodology AEP Ohio In-home Energy Program /3/5 Page 4 of 4