Network Outage. Member Impacting Project Overview - Network Outage

Transcription

1 Member Impacting Project Overview - Network Outage Page 1 of 6

2 Table of Contents Network Outage Table of Contents... 2 Version Control... 2 Document Purpose... 2 Executive Summary... 3 Business Impact... 3 Technical Impact... 3 Member Requirements... 5 Implementation/Back-out Plan... 5 Summary of Timeline... 5 Assumptions... 6 Risks... 6 Additional Documentation... 6 Communication Plan... 6 Next Steps... 6 FAQs... 6 Version Control Version Date Author Change Description Draft 3/2 A. Ralls Updated draft for review/comment/edit Document Purpose This template should be used to provide initial and ongoing communication of member impacting projects to the CWG and membership. The Project Manager should provide the MIPO with an initial review period. The CWG Representative should review the MIPO and provide feedback and response, including request for a MIPO review meeting, during the comment period. All MIPO updates will be red-lined, and that version will be saved as MIPO_<PR#_NAME_V#.R#> where V# is the version number associated with the touch point, and R# is the release within that touchpoint. The latest version will have accepted redline from the previous version, and any new changes redlined. The CWG and/or project liaison will be notified of any MIPO change. Page 2 of 6

3 Executive Summary Network Outage SPP has scheduled required network maintenance to upgrade our infrastructure to better support our movement to highly availably systems; this work will impact internal operations and our members on Saturday, April 2, 2011 from 8:30 a.m. to 3:30 p.m. CPT. This will necessitate an EIS Market suspension with ramp out to begin at 8:30 a.m. CPT. The actual outage is anticipated to be 7 hours in length, with the maintenance window extended for verification. It will be necessary to operate from our alternate site for the duration of this maintenance, and some applications and services will be unavailable or will utilize workarounds during this time. Business Impact A market suspension will be invoked prior to initiating the maintenance; market participants will follow normal procedures for a market suspension. Many systems will not have connectivity to the alternate systems during the maintenance, so there will be limited or no DR capability.these include: SPP Corporate will be queued but not sent for the duration of the outage EIS Market FTP (FTP1.SPP.ORG) Certain systems, which are located in the datacenter that do not have secondary counterparts in our alternate site will have no functionality. This includes: OPS1 Portal spp.org portal.spp.org The Integrated Test Environment Users Impacted Market Participants EIS market will be suspended, and the Market User Interface (MUI) aka the market portal will be unavailable during the outage window. ICCP users secondary SPP ICCP link will show as down, and EI NSI values will be zero. Replicated Data users (AEP, KCPL, EDE, BPU, OPPD, OMPA, NPPD, LES, Westar, MWE) will have no functionality during the outage window. The total NSI value (sum of EI and RTOSS) will be Invalid due to the loss of the EI NSI values. Dispatch instructions will indicate Invalid quality and are not to be used. OPS1 users will have no functionality during the outage window. Ace Diversity Interchange (ADI) users (AEP, EDE, and XCEL) ADI will be suspended prior to the failover to the secondary EMS, and again during the transition back to the primary using the standard method. Business Functions Impacted Market Operations Reliability Tariff and Scheduling Technical Impact Systems/Processes Impacted EIS Market (portal.spp.org/spp) The Market will be suspended, members will not receive XML notifications, and MPs will need to self-dispatch for the duration of the suspension. EI NSI will be zeroed for the market suspension, and thus the EI NSI value transmitted via ICCP will be zero. Page 3 of 6

4 RTOSS NSI will indicate Invalid quality and should not be used for AGC. Dispatch instructions will indicate Invalid quality and are not to be used. portal.spp.org and programmatic uploads or downloads via the API will not be available during the outage. The Market and Settlements portal/market User Interface (portal.spp.org/spp) will be unavailable during the outage. LIPPostings will not be produced for the duration of the market outage OPS1 (sppoasis.spp.org/ops1) Users will not be able to enter outages for the duration of the maintenance. The workaround of calling SPP s Operations for manual entry of transmission or generation outages will be employed for the duration of the outage. Users will not be able to access any reports via OPS1 Time error correction Time error correction notifications will not be sent. Though it is unlikely it will be necessary during the outage, SPP will employ the backup process of communicating these via direct call or satellite phone if necessary. EMS Ace Diversity Interchange (ADI) will be suspended during the transition to the alternate EMS, and again when the primary EMS connectivity is restored. ICCP The EI NSI values transmitted via ICCP will be zero. The total NSI value (sum of EI and RTOSS) will be Invalid due to the loss of the EI NSI values. Dispatch instructions will indicate Invalid quality and are not to be used. MOD (dcptamappa/modweb) Models on Demand will not be available during the outage. FTP (ftp1.spp.org) ftp1.spp.org will be unavailable during the outage window. ftp2.spp.org will be available. NSI via ftp1.spp.org (2 and 6 hour NSI files) will be unavailable for the duration of the outage. NSI via ftp2.spp.org (2 and 6 hour NSI files) will be available for the duration of the outage. Generator and Transmission Outages, Load Forecast, Hourly Load, and Control Performance Survey information cannot be submitted via ftp1.spp.org during the outage. They may be submitted via ftp2.spp.org if the account and functionality is replicated at the user site and SPP. Data Push The schedule detail data push will be down during the outage. We will push queued data out in the middle of maintenance window and again at the end of the maintenance to avoid extreme file sizes due to the duration of the maintenance window. Engineering Facility Generation Impact Studies ICT Studies (entergystudies.spp.org, entergystudies.spp.org/geninterhomepage.cfm) ITO Studies (lgeestudies.spp.org, lgeestudies.spp.org/geninterhomepage.cfm) RTO Studies (studies.spp.org, studies.spp.org/geninterhomepage.cfm) These websites will not be available during the outage. Page 4 of 6

5 ITE The Integrated Test Environment will be shut down as of 2:00 p.m., Friday, April 1st in preparation for the loss of connectivity to that environment. As it is non-essential, the environment will be restored by 10:00 a.m. Monday, April 4th. Communications (spp.org) Spp.org corporate website will be down for the duration of the outage; LIP, SLIP, and Offer Cap information will not be available via the website. All to or from any spp.org address or any of the distribution groups will be queued for the duration of the outage; there may be delay in delivery of or responses to e- mail. Member Requirements Members are asked to review an assess this information for any missed impacts. It is asked that any questions or comments are provided by Friday, March 18 th, including the request for a deep dive call specific to this effort. Testing Internal testing in preparation for this maintenance is ongoing. There is not member testing required for this effort. Training N/A for this effort. Implementation/Back-out Plan This maintenance is scheduled to occur on April 2, 2011 from 8:30 to 3:30 p.m. CST, with a contingency date of April 9 th and April 16 th of 2011 A backout plan is included and accounted for in the project plan. Should it be necessary to backout, members will be notified of the backout and contingency plan. Summary of Timeline Date Responsible Party Action 3/3/2011 Project Team Provide MIPO/Work notification to members 3/18/2011 Member Complete review, assessment, and provide feedback 4/1/2011 Project Team Provide confirmation work notification 4/2/2011 Project Team Go/no-go call communication 4/2/2011 Project Team Provide completion of work notification Page 5 of 6

6 Assumptions None at publication date. Risks As with any system maintenance, there are inherent risks of missed or not adequately assessed impacts that may lead to unplanned system downtime. The goal in communicating this maintenance proactively is to lessen that risk. It is asked that our membership review this information for any missed impact and reply with that information at the earliest convenience. Additional Documentation None at publication date. Communication Plan There will be a go/no-go call held the morning of the scheduled maintenance; this call will be attended only by essential SPP staff, and should a no-go be decided at any point, the orginial work notification will be resent with the intent to reschedule to the alternate date of April 9, 2011 or April 16, A confirmation work notification with intent to proceed will be sent one day prior to the implementation date. A start of work notification will be sent immediately prior to the maintenance beginning. A completion of work notification will be sent immediately following completion of all maintenance and restoration of full functionality.all project communication and information will be posted to the SPP Change Working Group Project Documentation folder. This MIPO will be updated upon change or with any new information, a redline version posted to the project documentation folder, and the CWG notified. Next Steps Action Assignee Status & Due Date Send project communication and identify liaison at member/participant companies as necessary CWG Staff Secretary In Progress 3/2/2011 Response due CWG Representative In Progress 3/18/2011 FAQs Frequently asked questions will be added to the document as identified or necessary. Page 6 of 6