Meeting Minutes Reliability Metrics Working Group

Transcription

1 Meeting Minutes Reliability Metrics Working Group February 12, a.m. 5 p.m. ET February 13, a.m. 1 p.m. ET SERC Office 2815 Coliseum Centre Drive - Suite 500 Charlotte, NC Convene A regular meeting of the NERC Reliability Metrics Working Group (RMWG) was held on February 12-13, 2009 in Charlotte, North Carolina. Chairman Herb Schrayshuen convened the meeting at 8 a.m. Present in the meeting in addition to Chairman Schrayshuen were Vice Chairman Bill Adams, Scott Benner, Stuart Brindley, Gary Bullock, Heide Caswell, Jim Eckert, Raj Ghai, David McRee, Jeff Mitchell, Ed Pfeiffer, Jerry Rust, John Simpson, Chad Thompson, Wayne Coste, David Durham and Ali Ghassemian. Also present in the meeting was Jessica Bian, Secretary, Aaron Bennett and John Moura from NERC assessment team. Howard Tarler and Laura Elsenpeter participated via a conference call bridge. NERC Antitrust Compliance Guidelines The secretary directed participants attention to the NERC Antitrust Compliance Guidelines included in the agenda. Consent Agenda Chairman Schrayshuen presented the consent agenda and reviewed action items from the January 14 group call. Without any comments, RMWG approved the January 14 conference call draft minutes. Report from Transmission Owners and Operators Forum Forum liaison David Durham provided a Forum metrics update. In 2008 the Forum reviewed industry benchmarking and related metrics initiatives, examined INPO processes for event reporting and analysis and identified opportunity to quantify/trend transmission and operational risk events. Currently the Forum is working to develop new metrics and standard cause codes to identify areas the industry needs to address in order to improve. Pilot results for transmission and operational risk events were also included in the update (note that Forum s presentation is posted at the RMWG data site) Village Blvd. Princeton, NJ

2 Report from the RFWG Liaison Chairman Schrayshuen summarized discussions at the January 27 RFWG conference call, especially those linked between metrics and the Reliability Concepts document. The document is available at Items of discussion included review of RMWG scope and possibility of working with RFWG to clarify terminology not defined in NERC s Glossary of Terms. Report from GTRPMTF Liaison Chairman Schrayshuen informed the group on the creation of the G&T Reliability Planning Model Task Force. He noted that this new task force will focus on computing composite reliability indices and identify possible metrics, which can be used in LTRA. The liaison will provide future updates and answer questions the group may have. Report from OC Executive Committee Liaison Jerry Rust provided a RMWG status update at the February 6 OC Executive Committee. The committee discussed the use of word Dashboard, noted current NERC benchmarking dashboard update is too slow and suggested to replace Dashboard with Indicators. To the majority of RMWG members the term refers to a process of measurement which is a real time activity. RMWG placed this item to a Parking Lot for further discussion next day and understood that the term Dashboard is also mentioned in the Rules of Procedure (ROP). Jerry continued that the committee asked what long term goals of benchmarking are. Chairman Schrayshuen advised the group to review the ROP and provide the answer at next RMWG face-to-face meeting in May. Report from RAS Liaison Chairman Schrayshuen briefed RAS on the development of ALR metrics. RAS inquired whether RMWG plans to write a chapter of reliability historic trends for 2009 LTRA. Chairman Schrayshuen stated that RMWG will search volunteers to draft and review the chapter. Report from Team Chair on Team Deliverable Jerry Rust, Team 1 Lead, presented metrics and initial SMART ratings for ALR 1 and ALR 2. Team 1 proposed the following ALR 1 metrics: EEA 3, Voltage Schedules, IROL, IROL Load Duration Curve, Maintaining the required amount of reserve, and Reliability Based Control Standard (held for future consideration). The ALR2 metrics were Events resulting in unplanned loss of load, UFLS and UVLS Usage, DCS Failures, and DCS Events Greater than MSSC. Stuart Brindley, Team 2 Lead, outlined the team 2 metric proposal. The metrics for ALR3 were Disturbance Containment, IROL Standard Violations, IROL Exceeded and SPS Operations. The metrics for ALR 4 were Misoperation of protection systems caused by human error or equipment, Loss of protection systems and System Operating Limit (SOL) exceeded. 2

3 John Simpson, Team 3 Lead, highlighted the team 3 recommendation. The following metrics were proposed for ALR5: Stability restoration (unstable conditions have occurred), Cascading outage restoration, Uncontrolled separation restoration, and Widespread outage restoration. The ALR6 metrics are Transmission Constraint Mitigation, Capacity and Energy Deficiency, Reserve Margin, Demand Side management (DSM) and Facility Redundancy. SMART Methodology Chairman Schrayshuen led the group discussion on whether the methodology worked and what to improve if the answer is yes. The group felt in general the SMART was a right tool to use at the beginning of metric development process. There were a total of 50 metrics proposed so far by RMWG. SMART enabled the group to rank the metrics and work on the most relevant ones in Suggested improvement included better clarifications on scores and obvious distinctions between Measurable and Attainable. Metrics Template and Indexing Chairman Schrayshuen introduced a metric template idea and explained each item in the template. To fully comprehend scope of proposed metrics, each team will need to fill out the template and provide attributes of each metric, including data source and reporting guidelines. Chairman Schrayshuen suggested RMWG may adopt other methods in the future to develop metrics. Indexing might be applicable to reliability metrics development and can be used similarly as to how CPI is constructed. EEA History Data SERC Report Chairman Schrayshuen presented a SERC EEA data analysis report, where data issues and gaps were identified. Jessica Bian questioned completeness of data set and noted she will follow up with the NERC staff who sent the EEA data to SERC originally to find out validity of data source. In order for the group to get familiar with the EEA application, Ms. Bian suggested to have Paul Baratelli, an NERC IT staff, to give an overview of the application on March 26 conference call. The group could offer input on what enhancement features the application might need to meet automatic metric reporting needs. Report Format Chairman Schrayshuen emphasized the importance of good delivery mechanism and encouraged every member to suggest appropriate formats for metrics reporting. Heide Caswell presented sample outlines of PacifiCorp s performance reports, covering various geographic areas. Mr. Eckert provided an overview of benchmarking tools Exelon uses, including peer rankings, quartile trend analysis and annual communication documents. 3

4 Adjourn and Reconvene The group adjourned at 5:05 p.m. EST and reconvened the following morning at 8:00 a.m. Formation of the Report Team Recognizing importance of delivery mechanism, Vice Chairman Bill Adams formed a special report team, leading to create appropriate formats for metrics reporting. Ms. Caswell, Mr. Rust and Mr. Eckert volunteered to join the team. A team conference call will be set up to draft a report outline. RMWG Deliverables Chairman Schrayshuen provided a high level summary of RMWG s three year work plan. The main deliverable in 2009 is to submit a metric recommendation report and obtain PC s and OC s endorsement in June. The group will focus on the dashboard enhancement and update in the third quarter of Jessica Bian reviewed current PC/OC organization charts and a new PC structure that may be adopted at its March 17 meeting. Chairman Schrayshuen pointed out another major effort between February and the end of the year is liaison and coordination activities. RMWG plans to reach out to 15 committees/subgroups to seek their feedback and ensure their agreement. Chairman Schrayshuen noted the group will revise the three year work plan to reflect recent changes, including removal of the word Dashboard and review of white paper. Parking Lot Issues Chairman Schrayshuen led discussion on the following parking lot items gathered from the meeting (Note that action items or resolutions for each item are available at RMWG s data site). 1. Identify a replacement word for dashboard 2. Identify a replacement word for Benchmarking 3. Volunteers for operations Historical Trends section of the LTRA 4. Revisit SMART purpose- Attainable 5. Markets issues. Whatever we do it should be applicable to both traditionally organized regions and market regions 6. Request an interpretation for the definition of the SPS? 7. Accommodate duplicate metrics 8. Team 2 new category of metric to address system vs. facility protection 9. Noted that adequacy we do not have a comprehensive throughput metric for transmission. Should we develop one? 10. Modification of SMART to address relative weighting of items differently 11. Develop a matrix to show coverage of ALR elements 1-6 4

5 12. What is the purpose of the metrics group effort? How will the group be involved into benchmarking, including interpretation and summary of the findings on an annual basis? 13. Wind Metrics what is needed? 14. Need resource metrics, related to energy storage? 2008 System Performance Update Jessica Bian presented 2008 EEA and disturbance event trends. The trend analysis also quantified leading root causes of disturbance events for 2006 and 2007, which revealed and prioritized current reliability issues. The three leading root causes identified are protection system misoperations, equipment failure and human error. Protection system performance has caused or exacerbated a growing percentage of bulk power system outages over the past several years, contributing to over 40% of tracked disturbances in Preliminary figures suggest that the most violated standard reported in 2008 was PRC-005 Transmission and Generation Protection System Maintenance and Testing. This trend will require additional analysis in 2009 and ultimately require new approaches to mitigate root causes. Plans for Next Team Discussion Based on methodology discussions held on previous day, each team will have conference calls to calibrate the SMART scores and accommodate duplicate metrics that generated by different teams. Future Meetings/Calls No changes were made to 2009 conference call schedules. The face-to-face meeting in May was finalized. Chad Thompson of ERCOT will be the host in Austin, Texas. The September face-to-face meeting will be in Portland, Oregon, hosted by Jerry Rust. There being no other business, Chairman Schrayshuen adjourned the meeting 11:55 am EST. Submitted by, Jessica Bian Jessica Bian Secretary 5