Market Participant Testing for Regulation Compensation (FERC Order 755) PR Test Approach. September 24, 2014

Transcription

1 Market Participant Testing for Regulation Compensation (FERC Order 755) PR Test Approach September 24, 2014

2 Revision History Date or Version Number Author Change Description Comments 0.1 Leann Poteet Initial Draft 0.2 Market Participant Test Approach 1

3 Table of Contents Revision History...1 Overview...3 Test Objectives... 3 Market Systems Success Criteria...3 Settlement System Success Criteria...5 Test Data...6 Testing Scope...7 In Scope... 8 Out of Scope... 8 Test Schedule...8 Regulation Compensation Market Participant Scenarios...10 Test Preparation...12 Test Execution...12 Communication Plan...13 General Information and Inquiries Issue Reporting Testing Checkpoint Meeting Exit Criteria...13 Supporting Documents...13 Acronyms...14 Market Participant Test Approach 2

4 Overview The Regulation Compensation (FERC Order 755) project provides enhanced functionality that pays regulation providers according to performance in response to SPP regulation deployment signals, in compliance with FERC Order 755. Regulation service will be defined as distinct Capacity and Mileage components which will be priced, measured and paid separately. FERC Order 755 requires implementation of a two-part payment so that Resources are compensated for the Regulation Service they provide and improve market efficiency. This change impacts the Markets User Interface and Application Programming Interface (API) for Market Participants, Market Operator Interface (MOI), Market Clearing Engine (MCE), Enterprise Analytical Data Store (EADS), Post Operations Processing System (POPS) and the Settlements system. Marketplace Protocol changes have been approved (MPRR 102) and Marketplace Tariff changes have been filed with FERC and are awaiting approval. The key deliverables are: 1. Updated Markets functionality to clear Regulation offers based on the calculated Regulation Service Offers 2. Calculate Regulation Up/Down Service MCPs and Regulation Up/Down Mileage MCPs 3. Updated Settlements functionality to compensate Regulation providers based on the Regulation Mileage actually delivered This project impacts the Market Participant s (MPs) Offer Submission systems and Shadow Settlements systems. Existing web services were modified to support the submission of Regulation Service Offers. New MCPs (the Regulation-Up Mileage MCP and Regulation-Down Mileage MCP) have been added, modification of existing Settlement charge types, and two new settlement charge types were added. The purpose of this document is to provide Market Participants with information needed to prepare for and execute tests through the Member Test Environment (MTE) using Marketplace Portal, Markets UI/APIs, and Settlements UI/APIs. Test Objectives The objective of MP testing is to verify SPP and Participant systems, processes, and resources operate in compliance with FERC Order 755 as well as Marketplace Protocols. Market Systems Success Criteria Regulation Qualified MPs are able to submit Regulation Mileage Offers via UI/APIs Market results are posted to the UI Market result notifications are provided via XML Market Clearing information from MTE will be sent to RTGEN via ETA. RTGEN ITE will generate setpoints and will populate POPS to settlements in MTE. MPs will receive setpoints via ITE ICCP while testing in MTE. Retrieval of RTBM Regulation-Up Mileage MCP through the Markets UI/API Retrieval of RTBM Regulation-Down Mileage MCP through the Markets UI/API Retrieval of Regulation Up MCP Market Participant Test Approach 3

5 Retrieval of Regulation Down MCP Detailed test cases will be provided in order to execute Regulation Compensation entry into the Markets UI/API. The following tests should be performed: Regulation Qualified MPs submit two-part Regulation-Up Offer (Capability and Mileage) that includes Regulation-Up mileage offers using the Markets UI/API Regulation Qualified MPs submit two-part Regulation-Down Offer (Capability and Mileage) that includes Regulation-Down mileage offers using the Markets UI/API Regulation Offers are cleared based on the calculated Regulation Service The following APIs are used for Submissions and Retrieval of Regulation Mileage Offers: o PostEnergyOverride Set (XML Notification) o GetEnergyOverrideSetByDay A new override type has been added to the above operations for Day Ahead Cleared Offers o GetMarketMCPSummaryByIntervalSet o GetMarketMCPSummaryByIntervalSetByDay Mileage price has been added to the above operations o PostReserveOfferSet o PostReserveResourceOfferSest o PostReserveEDRResourceOfferSet o PostReserveMitigatedOfferSet o PostReserveMitigatedResourceOfferSet o GetReserveEDRReserveOfferSet o GetReserveEDRResourceOfferSetByDay o GetReserveMitigatedOfferSet o GetReserveMitigatedOfferSetByDay o GetReserveOfferSet o GetReserveOfferSetByDay o GetReserveResourceOfferSet o GetReserveResourceOfferSetByDay A mileage price has been added to all resource offer operations for the Reserve Web Service o GetReserveDispatchSet o GetReserveDispatchSetByDay o PostReserveDispatchSet (XML Notification) Mileage MCP has been added to the above Real Time Cleared Operating Reserve Operations: o GetReserveSystemRequirementSet o GetReserveSystemRequirementSetByDay o PostReserveSystemRequirementSet (XML Notification) Mileage Factor has been added to the above System Requirements Operations Market Participant Test Approach 4

6 MPs using the following Markets Web services will be impacted by a new web service version to support Regulation Compensation. Regression testing of these services should be executed to ensure applications functions correctly o MarketService New web service version number to support the addition of Mileage MCPs to Real-Time results o EnergyService New web service version number to support the addition of Day- Ahead Cleared overrides specific to Regulation Offers o EnergyNotifyService - New web service version number to support the addition of Day-Ahead Cleared overrides specific to Regulation Offers o ReserveService - New web service version number to support changes to Operating Reserve Offer submissions, Real-Time Cleared Operating Reserve results and retrieval of Mileage Factor o ReserveNotifyService - New web service version number to support changes to Real- Time Cleared Operating Reserve results and retrieval of Mileage Factor Participants with Contingency Reserve Resources will need to modify their API resource offer submissions as part of the Web service changes. Please refer to the Marketplace Markets Web Services_Reg Comp specifications posted on SPP.org for more details on the Markets API changes associated with the Regulation Compensation project. Settlement System Success Criteria Settlement results for Regulation Compensation MP testing will focus on the four settlement charges that are either new or have been changed to measure Regulation Mileage payments. These four charges will likely be Market Participants primary focus during the Regulation Compensation Market Participant Testing period: Real-Time Regulation-Up Service changed to include the Reg Up Excess and Unused Amounts Real-Time Regulation-Down Service changed to include the Reg Down Excess and Unused Amounts Unused Regulation-Up Mileage Make Whole Payment New charge type to assure cost recovery for Reg Up Unused Mile Amount Unused Regulation-Down Mileage Make Whole Payment New charge type to assure cost recovery for Reg Down Unused Mile Amount. The results of intermediate calculations in those charges, and/or the results of those four charges in turn indirectly impact other settlement charges that were changed for the Regulation Compensation rules implementation, but those impacts are driven by the output of the four charges noted above. These are the additional charges that are indirectly impacted by Regulation Compensation implementation: Day-Ahead Make Whole Payment Intermediate results of the Reg Mileage MWP charges above are utilized in the DA MWP cost and revenue calculations RUC Make Whole Payment Intermediate results of the Reg Mileage MWP charges above are utilized in the RUC MWP cost and revenue calculations Real-Time Regulation-Up Service Distribution Amount Unused Reg Up Mile MWP amounts are now included in the costs to be distributed. Market Participant Test Approach 5

7 Real-Time Regulation-Down Service Distribution Amount Unused Reg Down Mile MWP amounts are now included in the costs to be distributed Real-Time Regulation Non-Performance Amount Includes the impacts of Reg Mile Excess and Unused Amounts Revenue Neutrality Uplift Distribution Amount includes the new Reg Mile MWP charges in the RT Revenue Inadequacy component of the RNU charge. Additional market settlement considerations for Regulation Compensation Market Participant Testing period: The scope of MP testing has been narrowly defined to demonstrate the Regulation Compensation capabilities of the SPP Systems. To this end, SPP has eliminated systems that have no impact on, or are not impacted by the Regulation Compensation implementation. The omission of some SPP Systems will have minor impacts on Settlement results that were not impacted by Regulation Compensation: RTOSS Schedule System not in scope The RTOSS system provides the Market and Settlement systems with import and export schedules in DA and RT. Import and export schedules have no impact on Regulation Compensation outcomes and are not impacted by any Regulation Compensation system changes. SPP will not utilize the RTOSS system during Regulation Compensation MP testing. o The Market System will use a NSI (Net Scheduled Interchange) value from the Production environment for purposes of market dispatch. o Settlements will not retrieve any import or export schedules from RTOSS for Settlement. The absence of import/export schedule data in Settlements is expect to lead to skewed DA and RT Revenue Inadequacy amounts in the RNU calculation. It may also lead to DA Congestion collection abnormalities which may skew the TCR funding. o Settlements will use a NSI value equal to 0 mw s for all hours of Settlement. The use of NSI = 0 mw s will cause the Net Inadvertent component of the RNU to be larger than normal. Market Clearing/Dispatch and Telemetry differences between the Production and MTE As previously noted, during the Regulation Compensation MP testing, the Market Clearing/Dispatch will be established by the systems in MTE, and telemetry will be provided by the SPP Production environment. This delta will not impact the ability of MPs to test Regulation Compensation; however some non-regulation Compensation settlement charges may produce abnormal results. Impacts in MTE include, but may not be limited to: o Higher than normal instances of URD penalties. o Resource commitments for resources that do not actually come on line. o Resources that come on line without specific resource commitments. o Odd dispatch patterns. o Odd congestion patterns. Test Data SPP will create the initial resource offers for RTBM, Day-Ahead Market and Mitigation in MTE which will then roll-forward until updated by the MP. MPs may update the resource offers as often Market Participant Test Approach 6

8 as needed; once they are updated, the resource offer information will continue to roll-forward until changed by the MP. SPP will utilize a process called Create Day to submit a static set of Demand Bids and Virtual Bids/Offers for future Operating Days. If desired, MPs may submit their own Demand Bids and Virtual Bids/Offers that differ from the static set of test data. During specific scenario testing, specific data may be needed from the MPs in order for the Scenario to be successful and avoid retesting. This data will be documented in the Scenario details and reviewed during testing meetings with the MPs. Markets Data Frequency Submission of Data Day Ahead Offers Daily/Hourly Roll Forward or MP Submitted Resource Offers Daily/Hourly Roll Forward or MP Submitted Mitigation Offers Daily/Hourly Roll Forward or MP Submitted Demand Bids Daily Create Day and/or MP Submitted Virtual Offers Daily Create Day and/or MP Submitted Not required for Reg Comp Scenarios CROW Outages Daily/ITE Not required for Reg Comp Scenarios. EMS Real Time ITE EMS Feed SCADA Real Time ITE EMS Feed Short Term Load Forecast Real Time ITE EMS Feed Mid Term Load Forecast Real Time ITE EMS Feed Settlements Data Frequency Submission of Data NSI Daily beginning 11/17 Manually by SPP Meter Data Daily SPP will use state estimator data in absence of submitted meter data. MPs are not required to submit Meter Data. Schedules NA Schedules are not required for Reg Comp Scenarios Testing Scope The scope of the testing covered in this document includes the functionality delivered as part of the Regulation Compensation. Market Participant Test Approach 7

9 In Scope The following systems/components must be available in the MTE environment to support the test objectives: Marketplace Portal Markets UI/API including XML Notifications Markets Systems EMS/RTGN (ITE) EADS POPS Settlements UI/API Out of Scope The following areas are explicitly out of scope for Regulation Compensation testing. This is not meant to be an exhaustive list of all out-of-scope topics. RTOSS/Schedules MTE solved studies between October 7 and November 17 Test Schedule The table below provides the test schedule for Regulation Compensation MP testing. Date Responsible Party September 11, 2014 SPP/MPs September 26, 2014 SPP/MPs Action Regulation Compensation Market Participant Testing Kick-Off Call MP Meeting to Review Test Approach and upcoming October dates October 7, 2014 SPP/MPs Markets UI/API available for Reg. Comp Offer submittal in MTE for October 14 and beyond October 10, 2014 SPP Regulation Compensation Scenario Documentation posting on spp.org October 14, 2014 MPs First OD in MTE with Regulation Service offers October 17, 2014 SPP/MPs MP Meeting to review Test Cases and Scenarios October 31, 2014 SPP/MPs MP Meeting to review Regulation Compensation Settlement Information Market Participant Test Approach 8

10 November 7, 2014 SPP/MPs Start weekly call with MPs to review the progress of testing November 10, 2014 SPP/MPs Regulation Mileage Offers submitted for November 17 Operating Day November 16, 2014 SPP/MPs Day-Ahead posts Mileage MCP for Operating Day November 17 November 17, 2014 SPP/MPs First Operating Day of Regulation Compensation MP Test November 27, 2014 SPP/MPs First Operating Day for Settlements Thanksgiving Holiday November SPP/MPs November MTE remains available, SPP staff holiday no support available December 1, 2014 SPP/MPs Update Mileage Factor Scenario December 2, 2014 SPP/MPs Mitigation Scenario Zone1 December 3, 2014 SPP/MPs First Settlement statement posted. Posting for OD December 4, 2014 SPP/MPs Mitigation Scenario Zone 2 December 8, 2014 SPP/MPs CR Event Scenario multiple CR events during the day(8:00 5:00 CPT) December 9, 2014 SPP/MPs Mitigation Scenario Zone 3 December 10, 2014 SPP/MPs Resource cleared in DA; not used in RT December 11, 2014 SPP/MPs Resource cleared in DA; goes on manual status within the hour Settlement Invoices Posted December 16, 2014 SPP/MPs Mitigation Scenario Zone 4 December 21, 2014 SPP/MPs Last Operating Day for Regulation Compensation December 22 January 2 SPP/MPs MTE remains available; limited SPP staff available for support December SPP Remaining Settlement Statements posted through last Regulation Compensation Operating Day. January 1 23, 2015 SPP/MPs Contingency Testing if needed January 23, 2015 SPP/MPs Market Participant Testing Complete On October 7, APIs for Regulation Compensation will be activated in the MTE environment. Once they are activated MPs may submit data for Operating Day October 14 and later. SPP support of the APIs and UIs also begins on October 7. Market Participant Test Approach 9

11 Please note that the Market system will be running in MTE, but study results will not be actively monitored until November 17. RMS tickets submitted on study results in MTE between October 7 and November 17 will not be researched. The following information is intended to help support data entry in MTE until the start of MP Testing on November 17. Application Function Change When to Test Markets UI Mileage Offer Oct Mileage Offer visible/available (first visible 7 days prior to the effective date). Offers displayed in the UI will have a value of 0. Within 7 days before the effective date(oct. -14) when Day-Ahead Market and RTBM are open for offers at least one day before and one after the Markets UI Markets UI Regulation Requirements RTBM Mileage MCP Markets API New API version use before effective date Day-Ahead Market / RTBM Cleared Day- Ahead Market Mileage Offers used in RTBM Oct. -7 Mileage Factors are visible for Operating Day Oct.- 14 and after Oct *Mileage MCP visible/available for operating day results on or after cutover date Oct. -7 Validation Mileage Offers must by $0/MWh for market hours before effective date Cleared Regulation Mileage Offers effective date When Operating Days prior to effective date and after effective date are in the window of data available through the Markets UI/API as future, current or historic operating days *RTBM results are available through Markets UI for Oct Oct. - 7 after release is installed in MTE *Oct. -13 Day Ahead Results to include OD Mileage MCP *All studies that solve between October 7 and November 16 are un-supported days in the MTE environment. SPP will be preparing and validating the systems in the MTE environment leading up to the start of MP Testing. Results during this time will not be supported. Regulation Compensation Market Participant Scenarios The following scenarios are planned during Regulation Compensation Market Participant Testing with Regulating Resource Asset Owners. SPP plans to track participation on the scenarios with the readiness team. Updating Mileage Factor The Reg Mileage Factor will be updated and changes will be reflected in the UI/API. MPs will receive notification that the Mileage Factor will be updated on 11/24 via CWG process to the Regulation Compensation Liaisons Mitigation is applied to capability and mileage regulation offers Market Participant Test Approach 10

12 Mileage compensation during a CR event to demonstrate actual mileage captured when more than one product is being deployed at a time. Resource cleared in Day Ahead but not used in Real Time Resource cleared in Day Ahead resource goes to manual status within the hour(control status 3) deviation charges are applied for regulation charges; both mileage and service The following calendar indicates the Operating Day the Scenarios are expected to be executed. Please refer to the Settlement Calendar on the MTE portal for settlement postings. December Su Monday Tuesday Wednesday Thursday Friday Sa Updating Mileage Factor (MPs to receive notification on updating Mileage Factor on 11/24) 7 8 CR Event multiple CR events during the day will occur Mitigation Zone 1 9 Mitigation Zone 3 Statements post for OD 11/27 10 Resource cleared in DA but not used in RT Mitigation Zone 2 11 Settlement Invoice posting Resource cleared in DA then goes on manual status for the hour SPP Analysis on Scenario participation and overall success 12 SPP Analysis on Scenario participation and overall success Mitigation Zone Settlement Invoice posting 25 SPP Analysis on Scenario participation and overall success SPP Analysis on Scenario participation and overall success SPP Holiday SPP Holiday Market Participant Test Approach 11

13 The following scenarios may occur naturally on any given day without being scheduled. SPP will track these and schedule a specific date(s) in order to meet participation for all regulating resource Asset Owners if needed. Unused mileage mileage not used in deployment will be accounted for in Settlements Non-compliance - occurs daily when resources do not follow dispatch instructions Detailed documentation on how to execute each Scenario will be provided in October and posted to the Regulation Compensation folder on spp.org. It is expected that each scenario will provide the Bid to Bill experience. Test Preparation A Regulation Compensation Liaison kick-off was held on September 11. SPP will publish the following materials to the Marketplace Project Pinnacle (Phase II) Regulation Compensation folder on spp.org. These documents will assist MPs on test execution and result verification of test cases and scenarios. Updated Markets Web Services Technical Specifications for Regulation Compensation Updated Markets User Interface Business Validations for Regulation Compensation Updated Markets UI Guide post on September 30 Detailed Scenario documentation post on October 10 Member liaisons responsible for testing should review the materials before the start of MP testing first Operating Day, November 17; SPP will begin weekly calls on Friday s with the MPs beginning November 7 to review test cases, environment updates and upcoming scenarios. Test Execution The MP test execution window for Regulation Compensation functionality in MTE begins Monday, November 17, Scenarios are scheduled to complete in the month of December. Additional testing may continue until January 23. The following details are needed for test execution. Tests will be performed in the MTE MTE will use EMS data via an ITE feed SPP created Resource Offers that will roll forward o MPs may update Resource Offers as needed; once updated they will roll forward SPP will use Create Day process for Demand Bids and Virtual Offers o MPs may update Demand Bids and Virtual Offers as needed. Virtual Offers are not required for Regulation Compensation testing Test Cases and Scenario documentation will be published in October Support of MTE is Monday Friday 8:00 5:00 CPT Market Participant Test Approach 12

14 Scheduled maintenance and downtime will be sent via CWG notification process Communication Plan The following section describes communication methods through which MPs and SPP will interact throughout Regulation Compensation testing. General Information and Inquiries Submit all inquiries through the Request Management System (RMS) using the Project Pinnacle: Regulation Compensation Quick Pick. Issue Reporting For errors or unexpected results that occur during test execution, which require SPP troubleshooting or intervention, please provide error steps and details through RMS using the Project Pinnacle: Regulation Compensation Quick Pick. Testing Checkpoint Meeting Testing Checkpoint Meetings will be conducted weekly on Fridays beginning November 7 December 19. Additional Friday meetings may be added if the contingency testing period is needed. Exit Criteria MP Scenario testing is scheduled to complete in December. January will be used as contingency to repeat scenarios if needed. The Regulation Compensation MP testing period is scheduled to end on January 23, At least 45 Regulating Resources will have submitted Regulation Offers, selected in an interval and settled. 300 MW average cleared in RTBM amongst the collection of the testing Resources has been met Each Asset Owner with Regulating Resources will see the Regulation Compensation Settlement Charge Types and Bill Determinants executed Each Asset Owner with Regulating Resources participates with at least one regulating resource in Scenario testing SPP requests the MPs update the test case document with Pass/Fail, and comments if needed, and return weekly via RMS using the Project Pinnacle Regulation Compensation Quick Pick. SPP will track the participation of the Scenarios with the Readiness team on overall success and participation. Supporting Documents The following table provides a list of supporting documents for Regulation Compensation MP testing. Market Participant Test Approach 13

15 Document Name Regulation Compensation MIPO Document Location Regulation Compensation MIPO Marketplace Markets Web Services_Reg Comp Integrated Marketplace Market User Interface Business Validations_Reg_Comp Integrated Marketplace Market User Interface Guide_Reg Comp Markets Marketplace Technical Specification Inventory Settlements DEGs and WSDLs SPP Settlements External API Manifest Bilateral Schedules Data Exchange Document Meter Data Data Exchange Document Settlement Reports Data Exchange Document WSDLs XSDs Marketplace Markets Web Services_Reg Comp Regulation Compensation User Interface Business Validations Integrated Marketplace Market User Interface Guide_Reg Comp Markets Marketplace Technical Specifications Inventory Integrated Marketplace-Settlements Acronyms The following table describes key acronyms used in this document. Acronym API BSS CWG DA DEG EADS EMS EQR Description Application Programmatic Interface Bilateral Settlement Schedules Change Working Group Day-Ahead Data Exchange Guide Enterprise Analytical Data Store Energy Management System Electronic Quarterly Report Market Participant Test Approach 14

16 ETA ICCP IM ITE MCE MCP MIPO MOI MP MTE MUI NSI OD POPS RMS RTBM RT RTGEN RTOSS SCADA SPP UI WSDL XSD E-Terra Archive Inter-Control Center Communication Protocol Integrated Marketplace Integrated Testing Environment (Live Track Stack) Market Clearing Engine Mileage Clearing Price Member Impacting Project Overview Markets Operator Interface Market Participant Member Test Environment Markets User Interface Net Schedule Interchange Operating Day Post Operations Processing System Request Management System Real-Time Balancing Market Real-Time Real-Time Generation Regional Transmission Organization Scheduling System Supervisory Control and Data Acquisition User Interface Web Service Description Language XML Schema Definition Market Participant Test Approach 15