CONSULTATION. SMKI and Repository Testing Approach Document. Consultation opens: 12 th March Consultation closes: 10 th April 2015

Transcription

1 CONSULTATION SMKI and Repository Testing Approach Document Consultation opens: 12 th March 2015 Consultation closes: 10 th April 2015 DCC Public Page 1 of 11

2 Contents 1 Executive summary Introduction to the document Phasing of SRT Entry & Exit Criteria Scope of Testing Test Reporting Responsibilities Test Assurance / Audits Test Issue Management Test Scenarios Consultation questions How to respond Referenced Documents DCC Public Page 2 of 11

3 1 Executive summary The Data and Communications Company (DCC) is committed to a safe and secure smart metering environment to allow all electricity and gas customers in Great Britain to enjoy the benefits of being in control of their energy usage. The Smart Metering Key Infrastructure (SMKI) is a vital part of this safe and secure environment, so we are seeking stakeholders views on the SMKI and Repository Testing (SRT) Approach Document which sets out the scope of SMKI and Repository Testing and the manner in which testing will be conducted. On 28 November 2014 DCC published the SRT Approach Document as a working document with an informal invitation to provide comments. The comments received have been taken into consideration and the document is now published for consultation. This consultation paper briefly summarises the SRT Approach Document and asks questions to which we would welcome responses. The document is consistent with Section T5 of the Smart Energy Code (SEC). Following the consultation, and taking respondents feedback into account, this document will be submitted to the SEC Panel for approval as the basis for SRT. DCC Public Page 3 of 11

4 2 Introduction to the document SRT, which is required under Section T5 of the SEC, demonstrates the capability of the DCC and the component parts of the DCC Systems to interoperate with the Systems of Parties to the extent necessary for the SMKI Services and the SMKI Repository Service. The SRT Approach Document contains the entry criteria that must be met before testing can commence; sets out the manner in which the testing will be conducted; and describes the exit criteria that must be achieved. These exit criteria include the requirement for two Large Supplier Parties to complete SMKI and Repository Entry Process Tests (SREPT). The SRT Approach Document is based upon version 4,1 of the Smart Energy Code (SEC4.1). 3 Phasing of SRT The SRT Approach Document sets out three distinct parts within SMKI and Repository Testing: Part 1 SRT (DCC Testing conducted in isolation from any SMIP Test Phases): to test the SMKI Test Service and Test SMKI Repository in isolation, and is limited to the issuing of Test Certificates including the lodging of Test Certificates into the Test SMKI Repository. This testing will enable live certificates to be available in time for DCC Live Operations. Part 2 SRT (DCC Testing conducted during SIT): to validate the integration of the SMKI and Repository Service within the wider DCC ecosystem. Particular focus will be given to the interfaces between the Test SMKI Repository and the DSP. No Parties will participate in this testing. SMKI and Repository Entry Process Testing against the SMKI Test Service. Parties, RDPs and non-dcc Users must successfully complete the SREPT on the SMKI Test Service (incorporating Test SMKI Repository) before Live SMKI Certificates can be obtained. The tests that are required are set out in the SMKI and Repository Test Scenarios Document (SRTSD). Parties will not participate in Part 1 or Part 2 SRT. Once Parties, RDPs and non- DCC Users have successfully completed SREPT, they will be able to obtain Live SMKI Certificates. Q1 Phasing of SRT Do you agree with the phasing of SRT as set out above? If not, please give a rationale for your answer DCC Public Page 4 of 11

5 4 Entry & Exit Criteria The SRT Approach Document contains the entry criteria that must be achieved before SMKI and Repository Testing can commence and the exit criteria that must be achieved before SMKI and Repository Testing can complete. These are further deconstructed into entry and exit criteria for each of the three parts set out above. The exit criteria, which demonstrate that the SMKI and Repository Testing Objective (SEC T5.2) has been achieved, will form the basis of a report that will be provided to the SEC Panel for approval. Q2 Q3 Entry & Exit Criteria Do you agree with the entry and exit criteria that are included in the SMKI and Repository Testing Approach Document? If not, please give a rationale for your answer Do you agree that attainment of the exit criteria will demonstrate that the SMKI and Repository Testing Objective has been met? If not, please give a rationale for your answer. 5 Scope of Testing The SRT Approach Document sets out the scope of testing for each part of SRT. Part 1 testing validates the functions of the SMKI Service and SMKI Repository, while Part 2 testing validates the Recovery Procedures and the use of SMKI within the wider DCC ecosystem and will be performed within the Systems Integration Testing (SIT) environment. Part 1 non-functional testing will validate the performance of the test SMKI Service and SMKI Repository, confirming that Target Response Times can be met and that processing capability is maintained under periods of system stress, subject to the constraints of the test environments used. No non-functional testing is defined for Part 2 SRT as this is performed within the SIT environment and, as such, SIT nonfunctional testing could not be passed until the required level performance and resilience of SMKI is achieved. Q4 Scope of Testing Do you agree with the scope of functional and non-functional testing for Part 1 and Part 2 SRT, as set out in the SMKI and Repository Testing Approach Document? If not, please give a rationale for your answer 6 Test Reporting The DCC will provide the SEC Panel and the Secretary of State with a copy of the weekly Test Execution Reports for information. Part 1 SRT will report the progress of testing, quantity of issues, progress toward exit criteria, key risks and issues and an overall assessment of the status of testing. DCC Public Page 5 of 11

6 The DCC will provide a Test Completion Report to the SEC Panel for information at the end of Part 1 SRT. Similarly, the DCC will provide a Test Completion Report at the end of Part 2 SRT. Once the SRT exit criteria have been met in accordance with SEC 5.19 and 5.20, and having consulted with the Parties who have participated, the DCC will provide an SRT Completion Report to the SEC Panel for approval. Q5 Q6 Technical Readiness Do you agree with the weekly reporting of test execution progress? If not, please give a rationale for your answer. Do you agree with the approach to reporting the completion of Part 1 SRT and Part 2 SRT? If not, please give a rationale for your answer. 7 Responsibilities The SRT Approach Document sets out the main responsibilities for the parties involved in SMKI and Repository Testing, including those of the DCC, the DCC s Service Providers and of Testing Participants. A general obligation exists that requires participants to comply with the SEC, follow industry good practice and to take all reasonable steps to facilitate the achievement of the SRT Objective. The obligations on Testing Participants are limited to complying with the general obligations, above, and to conform to the SMKI and Repository Test Scenarios Document (SRTSD) with regards to planning, preparation, execution and completion of SMKI and Repository Entry Process Tests 1. Q7 Responsibilities Do you agree with the responsibilities for the parties involved in SMKI and Repository Testing? If not, please give a rationale for your answer. 8 Test Assurance / Audits The SRT Approach Document sets out the assurance processes that the DCC will undertake to assure the testing carried out during Part 1 and Part 2 SRT. These activities are: witnessing the execution of a subset of tests performed by the Data Service Provider (DSP) and the Trusted Service Provider (for SMKI); and 1 A Working Document version of the SRTSD was published by the DCC on 28 November 2014 and can be found on the DCC s website using this link. This document will be shortly be republished to address responses following the invitation to comment on the Working Document. DCC Public Page 6 of 11

7 an entitlement for the DCC to conduct product inspections, in line with the Service Providers contracts. Q8 Test Assurance / Audits Do you agree with the provisions for the DCC to assure and audit the execution of SRT? If not, please give a rationale for your answer 9 Test Issue Management Testing issues impacting the DCC will be managed via HP Quality Centre (HP QC), or a similar test management system. The processes and procedures for managing testing issues are in line with those proposed and consulted upon for other testing stages (namely Systems Integration Testing and Interface Testing). Similarly, the resolution of testing issues has been the subject of previous consultations. The requirements for Testing Participants to record testing issues during SMKI and Repository Entry Process Tests will be documented in the SMKI and Repository Test Scenarios Document 2. The SRT Approach Document provides an overview of the manner in which the test management system will be configured and the manner in which Issue Review Boards will be convened. It also sets out the manner in which issue severities will be allocated. Appendix A of the SRT Approach Document sets out the classification and description of Test Issue Severities and Test Issue Priorities. Q9 Q10 Test Issue Management Do you agree with the manner in which Issue Review Boards will be convened? If not, please provide a rationale for your answer. Do you agree with the issue severities and priorities set out in the SRT Approach Document? If not, please provide a rationale for your answer 10 Test Scenarios The SRT Approach Document sets out the Test Scenarios which will be conducted during Part 1 and Part 2 SRT, which the DCC will perform i.e. not requiring the participation of other Testing Participants. Part 1 testing validates the functions of the SMKI Service and SMKI Repository and will assure the functions and interfaces that Testing Participants will be required to 2 A Working Document version of the SRTSD was published by the DCC on 28 November 2014 and can be found on the DCC s website using this link. This document will be shortly be republished to address responses following the invitation to comment on the Working Document. DCC Public Page 7 of 11

8 test during SMKI and Repository Entry Process Testing and Users will access in the live environment. These tests are defined in sections 12.1 to 12.8 of the SRT Approach Document and will be completed before Testing Participants will be able to conduct SREPT. Part 2 testing validates the Recovery Procedures and the use of SMKI within the wider DCC ecosystem and will be performed within the Systems Integration Testing (SIT) environment. The Recovery Procedures are defined in sections 12.9 and in the SRT Approach Document. No Test Scenarios are defined for the use of SMKI within the wider DCC ecosystem as this will be validated by the tests performed during SIT. Q11 Q12 Test Scenarios Do you agree with the phasing of Test Scenarios, with Part 1 SRT covering the functions and interfaces for SMKI Service and SMKI Repository and Part 2 SRT covering Recovery Procedures and use of SMKI? If not, please give a rationale for your answer. Do you agree that the Test Scenarios defined provide sufficient coverage of the functions and interfaces for the SMKI Service and SMKI Repository? If not, please provide a rationale for your answer, including details of Test Scenarios that you believe to be missing, erroneous or excessive. Q13 Q14 General Are there any other points that you would like to raise on the SMKI and Repository Testing Approach Document? Please provide a rationale for each point raised. Do you consider that the approach to testing that is set out in the SMKI and Repository Testing Approach is consistent with a Good Industry Practice methodology? If not, please provide a rationale for your answer. 11 Consultation questions Q1 Q2 Q3 Do you agree with the phasing of SRT as set out above? If not, please give a rationale for your answer Do you agree with the entry and exit criteria that are included in the SMKI and Repository Testing Approach Document? If not, please give a rationale for your answer Do you agree that attainment of the exit criteria will demonstrate that the SMKI and Repository Testing Objective has been met? If not, please give a rationale for your answer. Q4 Do you agree with the scope of functional and non-functional testing for Part 1 and Part 2 SRT, as set out in the SMKI and Repository Testing Approach Document? If not, please give a rationale for your answer Q5 Q6 Do you agree with the weekly reporting of test execution progress? If not, please give a rationale for your answer. Do you agree with the approach to reporting the completion of Part 1 SRT and DCC Public Page 8 of 11

9 Q7 Q8 Q9 Q10 Q11 Q12 Q13 Q14 Part 2 SRT? If not, please give a rationale for your answer. Do you agree with the responsibilities for the parties involved in SMKI and Repository Testing? If not, please give a rationale for your answer. Do you agree with the provisions for the DCC to assure and audit the execution of SRT? If not, please give a rationale for your answer Do you agree with the manner in which Issue Resolution Boards will be convened? If not, please provide a rationale for your answer. Do you agree with the issue severities and priorities set out in the SRT Approach Document? If not, please provide a rationale for your answer Do you agree with the phasing of Test Scenarios, with Part 1 SRT covering the functions and interfaces for SMKI Service and SMKI Repository and part 2 SRT covering Recovery Procedures and use of SMKI? If not, please give a rationale for your answer. Do you agree that the Test Scenarios defined provide sufficient coverage of the functions and interfaces for the SMKI Service and SMKI Repository? If not, please provide a rationale for your answer, including details of Test Scenarios that you believe to be missing, erroneous or excessive. Are there any other points that you would like to raise on the SMKI and Repository Testing Approach Document? Please provide a rationale for each point raised. Do you consider that the approach to testing that is set out in the SMKI and Repository Testing Approach is consistent with a Good Industry Practice methodology? If not, please provide a rationale for your answer. DCC Public Page 9 of 11

10 12 How to respond Please provide responses in the attached template by 10 th April 2015 to the DCC at If you have any questions about the consultation documents, please contact Consultation responses may be published on our website Please state whether all, or any part, of your consultation response is confidential. Please note that responses in their entirety (including any text marked confidential) may be made available to the Department of Energy and Climate Change (DECC) and the Gas and Electricity Markets Authority (the Authority). If you have questions about our approach to consultations, please contact our Regulation Manager at DCC Public Page 10 of 11

11 13 Referenced Documents Document Title Issue Dated Smart Energy Code SEC /01/15 SMKI and Repository Test Scenarios Document (Working Document) /11/14 Table 1 Referenced Documents DCC Public Page 11 of 11