Enterprise Infrastructure Solutions (EIS) Request for Proposals. Section E Inspection and Acceptance

Transcription

1 Enterprise Infrastructure Slutins (EIS) Request fr Prpsals Sectin E Inspectin and Acceptance Issued by: General Services Administratin Office f Integrated Technlgy Services 1800 F St NW Washingtn, DC JULY 2017 EIS GS00Q17NSD3004

2 General Services Administratin Netwrk Services 2020 Enterprise Infrastructure Slutins Table f Cntents E.1 Intrductin... 1 E.1.1 FAR Clauses Incrprated by Reference (FEB 1998)... 1 E Clauses Incrprated by Reference Table... 1 E.2 Test Methdlgy... 2 E.2.1 Business Supprt Systems Verificatin Testing... 2 E Scpe... 3 E BSS Test Scenaris... 3 E BSS Test Cases... 7 E Test Results E Deliverables E.2.2 EIS Services Verificatin Testing E General Testing Requirements E Test Scenaris E Test Cases E Test Data Sets E Test Results and Acceptance E Deliverables EIS GS00Q17NSD3004 ii

3 General Services Administratin Netwrk Services 2020 Enterprise Infrastructure Slutins E.1 Intrductin This sectin describes the inspectin and acceptance plan fr the fllwing: Cntractr s Business Supprt Systems (BSS) EIS Services E.1.1 FAR Clauses Incrprated by Reference (FEB 1998) This cntract incrprates ne r mre FAR clauses by reference, with the same frce and effect as if they were given in full text. Upn request, the Cntracting Officer (CO) will make their full text available. The full text f a clause may be accessed electrnically at this address: The clauses in Table E apply at the cntract and rder levels, as applicable, depending upn the cntract type f the rder, r as specifically referenced in the applicable rder. E Clauses Incrprated by Reference Table Clause # FAR Clause # Title and Date Date E Inspectin f Supplies - Fixed Price AUG 1996 E Inspectin f Services - Fixed Price AUG 1996 E Time-and-Material and Labr-Hur MAY 2001 E Inspectin f Cnstructin AUG 1996 E Respnsibility fr Supplies APR 1984 E Warranty f Supplies f a Nncmplex Nature JUN 2003 E Warranty f Systems and Equipment under Perfrmance Specificatins r Design Criteria MAY 2001 E Warranty f Services MAY 2001 EIS GS00Q17NSD3004 1

4 General Services Administratin Netwrk Services 2020 Enterprise Infrastructure Slutins E.2 Test Methdlgy The cntractr shall fllw the verificatin and acceptance test methdlgy described in this sectin in develping the verificatin test plan(s) fr: Cntractr s Business Supprt Systems (BSS) EIS Services E.2.1 Business Supprt Systems Verificatin Testing The cntractr shall prvide a draft BSS Verificatin Test Plan (BSS Test Plan) with its prpsal and a final BSS Test Plan 30 days after ntice t prceed. This plan shall cmply with the test methdlgy fr BSS defined in Sectins E E The gvernment reserves 21 days frm the date f receipt f final plan t accept r reject the plan. If it is rejected, the cntractr will be given the pprtunity t update the plan based n gvernment cmments. Based n GSA Cnexus readiness and ther factrs, the gvernment may, at its ptin, ffer the pprtunity fr cntractrs t perfrm preliminary testing prir t award, but after submissin f prpsals. If this pprtunity is ffered, it will be ffered t all cntractrs wh submit a prpsal, pending nly the cntractr s demnstratin f primary security features such as anti-virus prtectin. Any such preliminary testing shall nt replace frmal testing pst-award. The gvernment ffers n guarantees that the GSA Cnexus cnfiguratin ffered as the preliminary system will be identical t the final system used in pst-award frmal testing. If the gvernment ffers such preliminary testing, the gvernment will issue terms and cnditins fr such testing which the cntractr must accept prir t accessing the test system. The cntractr shall prvide updates t the BSS Test Plan within 14 days f receipt f gvernment cmments. The gvernment reserves 14 days after receipt f the updated plan t accept r reject it. If necessary t gain apprval, the cntractr may repeat this prcess. See sectin G.2.3 BSS Final Cntract Acceptance fr final acceptance requirement. In supprt f BSS testing, GSA will prvide test parameters as fllws: BSS test scenaris are prvided in Sectin E BSS test cases are prvided in Sectin E Test metadata (including apprximate number f TOs, SOs, and ther data sets t be used in testing) will be prvided nt later than NTP. System reference data, as described in Sectin J.2.3, will be prvided nt later than NTP. Test data, as described in Sectin E.2.1.3, and test verificatin criteria will be prvided at the time f BSS testing. EIS GS00Q17NSD3004 2

5 General Services Administratin Netwrk Services 2020 Enterprise Infrastructure Slutins The BSS testing will be perfrmed during nrmal business hurs, 8:00am-5:00pm Mnday-Friday, Eastern Time. E Scpe The cntractr shall meet the fllwing Inspectin and Acceptance requirements: BSS testing shall verify that all BSS functinal, regressin and security requirements have been successfully met. BSS testing shall be perfrmed fr all management and peratin functins supprting Ordering, Billing, Inventry Management, Disputes, SLA Management and Truble Ticketing prcesses described in Sectin G and Sectin J.2. Security testing shall be based n the requirements described in Sectin G.5.6 BSS Security Requirements. The security requirements acceptance shall be based n: Assessment and Authrizatin (A&A) FedRAMP certificatin (if applicable) BSS testing shall include multiple test cases that are defined in Sectin E Test Cases. BSS testing shall include test cases fr quality, utility and custmer access features. The cntractr shall allw gvernment representative(s) t bserve all r any part f the verificatin testing. If the gvernment s requests, the cntractr shall perfrm tests t ensure cntinued cmpliance each time a new service is ffered r the cntractr mdifies features/functinality f the BSS that affect the functinal requirements described in Sectin G and Sectin J.2. The cntractr shall perfrm BSS verificatin testing accrding t the accepted BSS Test Plan at a mutually acceptable date with the gvernment. E BSS Test Scenaris E Testing Prir t initiating BSS testing, the cntractr shall: Prvide written ntice t the gvernment that the cntractr s BSS has passed its internal testing and is ready t begin BSS interface testing with GSA Cnexus. Prvide a finalized BSS Test Plan that is accepted by GSA. The purpse f the verificatin and acceptance testing is t ensure that the cntractr s BSS meets requirements in Sectin G and Sectin J.2. The cntractr shall supprt EIS GS00Q17NSD3004 3

6 General Services Administratin Netwrk Services 2020 Enterprise Infrastructure Slutins BSS security and functinal testing as defined in Sectin G.5.6 BSS Security Requirements and Sectin G.2.3 BSS Final Cntract Acceptance. E Test Scenaris The fllwing table cntains a high-level list f BSS Test Scenaris fr which the cntractr s BSS must pass the defined acceptance criteria. The cntractr shall address the test scenaris based n the functinal requirements defined in the relevant prtins f Sectin G and/r Sectin J.2 (see the RFP References clumn fr references). The scenaris shall address relevant data exchange mechanisms and validatin f data exchanged. Each Test Scenari is assciated with ne r mre Test Cases defined in Sectin E Test Scenari # RFP References Descriptin BSS-TS01 G J.2.9 BSS-TS02 G.3 J.2.3 Exchange structured data using the defined direct data exchange methds: XML via secure web services Pipe,, delimited table via SFTP The cntractr s BSS manages the fllwing as specified in Sectin J.2.3: Accept System Reference Data Prvide Direct Billed Agency Setup BSS-TS03 J.2.3 The cntractr s BSS manages Rle based access cntrl t all BSS functins (e.g. rdering, billing, inventry management, truble management, SLA management) BSS-TS04 G.3 J.2.4 The cntractr s BSS manages the prcessing f rders and generatin f required acknwledgments and ntificatins. Order types include: New service fr each f the services specified in Sectin C.2, Technical Requirements, that are included in the awardee s cntract Service Mves Service Discnnects Service Feature Changes Telecmmunicatins Service The cntractr shall demnstrate bidirectinal exchange f defined data structure that meets the interface specificatins as defined in Sectin G and Sectin J.2.9. The cntractr shall demnstrate successful TO Data Management initial setup and updates. The cntractr shall demnstrate that its BSS prvides the ability t define rle based users with privileged access t the BSS t meet the requirements as defined in Sectin J.2.3. The cntractr shall demnstrate that an authrized gvernment user can place an rder using the methds specified in Sectin J.2.4 and the rder ppulates the fields in the cntractr s BSS in a way that meets the requirements in Sectins G.3, G.5 and J.2. Using the direct data exchange methd defined in Sectin J.2.4, the cntractr shall demnstrate that its BSS can prvide all required CDRLs including: EIS GS00Q17NSD3004 4

7 General Services Administratin Netwrk Services 2020 Enterprise Infrastructure Slutins Test Scenari # RFP References Descriptin BSS-TS05 G.3 J.2.4 BSS-TS06 G.3 J.2.4 BSS-TS07 G J Pririty (TSP) Aut-sld CLINs Bulk Orders The cntractr s BSS handles rder supplements/updates that impact ther, in-prgress rders: Cancel rders Service Feature Changes Lcatin changes Changes t Custmer Want Date Changes t administrative data The cntractr s BSS handles rders fr administrative changes t the recrds fr previusly prvisined services as described in G.3 The cntractr s BSS manages Self-Service Prvisining and ther Rapid Prvisining rders and prvides the crrect ntices. 1) Service Order Acknwledgement 2) Service Order Rejectin Ntice 3) Service Order Cnfirmatin 4) Firm Order Cmmitment Ntice 5) Service Order Cmpletin Ntice The cntractr shall demnstrate that an authrized gvernment user can place a change r cancel rder using the methds specified in Sectin J.2.4 and the rder ppulates the fields in the cntractr s BSS in a way that meets the requirements in Sectins G.3, G.5 and J.2. Using the direct data exchange methd defined in Sectin J.2.4, the cntractr shall demnstrate that its BSS can prvide all required CDRLs including: 1) Service Order Acknwledgement 2) Service Order Rejectin Ntice 3) Service Order Cnfirmatin 4) Firm Order Cmmitment Ntice 5) Service Order Cmpletin Ntice The cntractr shall demnstrate that an authrized gvernment user can place an administrative change rder using the methds specified in Sectin J.2.4 and the rder ppulates the fields in the cntractr s BSS in a way that meets the requirements in Sectins G.3, G.5 and J.2. Using the direct data exchange methd defined in Sectin J.2.4, the cntractr shall demnstrate that its BSS can prvide all required CDRLs including: Service Order Administrative Change The cntractr shall successfully demnstrate the cmpletin f these rders. Nn-self-service rders shall be tested using bth crrectly placed rders and rders with related errrs. Self-service rders EIS GS00Q17NSD3004 5

8 General Services Administratin Netwrk Services 2020 Enterprise Infrastructure Slutins Test Scenari # RFP References Descriptin BSS-TS08 G.4 J.2.5 J.2.6 J.2.7 J.2.10 BSS-TS09 G.4.4 J.2.6 The cntractr s BSS prperly manages inventry and billing: Generates the inventry f services delivered by the cntractr Prduces utput that is cnsistent with rder and billing details Generates the detailed billing in accrdance with the Billing Invice (BI) CDRL Prperly handles usage-based billing Calculates billing based n the cntractr s awarded pricing Crrectly calculates the AGF due t GSA and prduces the required AGF CDRLs Prvides accurate calculatin f runding and prratin related t Billing, Taxes, Fees and Surcharges The cntractr s BSS prperly manages all dispute types with apprpriate handling fr: Billing disputes Inventry disputes SLA disputes Dispute tracking and reprting shall be tested with crrectly placed rders and t ensure that the cntractr s BSS des nt permit the placement f incrrect rders. Using the direct data exchange methd defined in Sectin J.2.4, the cntractr shall demnstrate that its BSS can prvide all required CDRLs including: 1) Service Order Acknwledgement 2) Service Order Cmpletin Ntice The cntractr shall demnstrate that its service inventry management system maintains a cmplete and accurate inventry f EIS service rders in a way that meets the requirements in G.7 and G.5 and Sectin J.2 CDIP and is verified and accepted by GSA. The cntractr shall demnstrate that the utput f its billing data elements is cnsistent with the rders entered int its BSS and that the billing data elements meet the requirements in Sectins G.3, G.5 and J.2. Using the direct data exchange methd defined in Sectins J.2.5- J.2.7, the cntractr shall demnstrate that its BSS can prvide all required CDRLs including: 1) Billing Invice 2) Billing Adjustment 3) Tax Detail 4) AGF Detail 5) AGF Electrnic Funds Transfer Reprt 6) Inventry Recnciliatin The cntractr shall demnstrate that its BSS can accept and issue disputes as well as tracking them t reslutin. Using the direct data exchange methd defined in Sectins J.2.5- J.2.7, the cntractr shall demnstrate that its BSS can EIS GS00Q17NSD3004 6

9 General Services Administratin Netwrk Services 2020 Enterprise Infrastructure Slutins Test Scenari # RFP References Descriptin BSS-TS10 G.8 J.2.8 The cntractr s BSS prperly manages SLA Management: SLA Reprting SLA Credit Request handling and respnse BSS-TS11 J.2 The cntractr s BSS prduces acceptable pen-frmat reprts defined in the CDIP: Mnthly Billing Infrmatin Memrandum Truble Management Incident Perfrmance Reprt Truble Management Perfrmance Summary Reprt BSS-TS12 J.2 The cntractr s BSS testing includes regressin testing f all key features including rdering, service assurance, and billing. NOTE: Applies nly t testing cnducted as part f system changes, nt initial BSS develpment. BSS-TS13 G.5.6 The cntractr s BSS has passed A&A as defined in Sectin G.5.6. prvide all required CDRLs including: 1) Dispute 2) Dispute Reprt The cntractr shall demnstrate that its BSS successfully tracks SLAs with assciated KPIs as well as reprting SLA perfrmance and prviding sufficient infrmatin t respnse t SLA Credit Requests. Using the direct data exchange methd defined in Sectins J.2.5- J.2.7, the cntractr shall demnstrate that its BSS can prvide all required CDRLs including: 1) SLA Reprt 2) SLA Credit Request Respnse The cntractr shall demnstrate, via sample reprts, that the penfrmat reprts specified are sufficiently detailed and clear s as t meet the gvernment s requirements. The cntractr shall demnstrate that its BSS meets regressin testing. The BSS test plan shall include regressin testing; hwever, actual regressin testing will nt be part f initial test and acceptance. The cntractr shall demnstrate that the BSS meets FISMA Mderate requirements. E BSS Test Cases The cntractr shall accept, incrprate int the BSS Test Plan, and successfully execute test cases prvided fr each f the test scenaris abve. The cntractr shall accept the fllwing test cnditins: EIS GS00Q17NSD3004 7

10 General Services Administratin Netwrk Services 2020 Enterprise Infrastructure Slutins N testing between the cntractr and GSA shall ccur until bth the cntractr s BSS and GSA Cnexus have passed unit testing. All testing t be perfrmed n the actual system t be used in delivering service (i.e. special purpse test systems shall nt be used). Unless therwise specified, all data transfers are t use the mechanism specified in Sectin J.2 fr that data set. The cntractr shall use GSA prvided test data fr all BSS verificatin testing unless specified therwise: This data shall be used fr testing purpses nly. N custmer live data shall be used fr testing. This data shall be a realistic simulatin f actual custmer data. The test data shall include, in sme tests, intentinal errrs intended t test the cntractr s BSS errr handling. BSS testing shall fllw a tiered apprach: The cntractr shall accept multiple test cases fr the test scenaris defined in Sectin E The cntractr shall accept, incrprate int the BSS Test Plan, and successfully execute each test case with ne r mre test data sets. In prviding test data sets, GSA will grup them int Test Subcases: Each Test Subcase shall cntain data sets intended t test a specific real wrld test case (e.g. a cmplete and accurate discnnect rder) Each test subcase shall include at least tw cmplete test data sets BSS functinal testing acceptance: The cntractr s BSS shall nt have cmpleted functinal testing until all BSS Test Scenaris (Sectin E.2.1.2) are passed. A test scenari shall nt be cnsidered passed until the cntractr s BSS prperly handles each assciated test case. A test case shall nt be cnsidered passed until the cntractr s BSS prperly handles each assciated subcase twice in successin using different data sets. A subcase shall nt be cnsidered passed until the cntractr s BSS prperly handles the data sets fllwing the prescribed actins with n errrs r warnings. BSS security testing acceptance is defined in Sectin G.5.6 and assciated references. The individual test cases are defined in the tables in the subsectins belw. Each test case table includes the fllwing headings: EIS GS00Q17NSD3004 8

11 General Services Administratin Netwrk Services 2020 Enterprise Infrastructure Slutins Test Scenari: The assciated test scenari frm Sectin E : Identificatin number fr the test case. Test Case Descriptin: Brief title f the test case. : Where the functinal requirements that are being tested can be fund. : Actins that must be cmpleted prir t implementing the test case (in additin t the general prerequisites fr all testing). Gvernment Input(s): Data the gvernment will prvide as input t the test case. Expected BSS Output(s): Expected data r actins frm the cntractr s BSS. Data Set Descriptin: Brief descriptin f the data sets the gvernment intends t prvide as part f testing. : Factrs t be checked prir t acceptance f the test results. The table belw defines the terms used: Criteria Successful data transfer Crrect technical aspects Evidence f failure ntificatin N partial imprt All required CDRLs Accurate data based n inputs Access granted Access denied N errrs displayed Definitin The cntractr demnstrates that data transmitted was received intact withut errr using the frmats and mechanisms described in the test case. The cntractr demnstrates that data transfers were cmpleted using the crrect mechanism, in the crrect frmat, and with the crrect structure. The cntractr demnstrates that expected ntificatins f failure were prperly issued. The cntractr demnstrates that their BSS des nt imprt partial data in cases where the data is crrupt r therwise cannt be imprted in full. The cntractr demnstrates that the expected CDRLs (listed in the expected utput sectin) are all delivered. The cntractr demnstrates that the data prvided in CDRLs is accurate and reflects the data prvided by the gvernment inputs and the prerequisites. The cntractr demnstrates that the user gains access t resurces as expected. The cntractr demnstrates that the user is denied access t resurces as expected. The cntractr demnstrates that the user is nt shwn any unexpected errrs. EIS GS00Q17NSD3004 9

12 General Services Administratin Netwrk Services 2020 Enterprise Infrastructure Slutins Criteria Apprpriate errrs are displayed CDRLs are internally cnsistent Cmplies with calculatin rules Each CDRL meets requirements Cntractr BSS receives ATO Definitin The cntractr demnstrates that the user is shwn the expected errrs. The cntractr demnstrates that the data prvided in the expected CDRLs is internally cnsistent between the set f CDRLs. The cntractr demnstrates that the data prvided in the CDRLs matches that which wuld be expected based n runding and prratin calculatin requirements. The cntractr demnstrates that the prvided CDRLs meet the requirements specified by the gvernment (used fr CDRLs withut detailed frmat requirements). Standard requirements include, at minimum: CDRL cntains the required infrmatin CDRL is clear and readily understd The cntractr demnstrates that the BSS has received Authrizatin t Operate (ATO) and has been apprved by GSA based n relevant security requirements as defined in Sectin G.5.6 and references therein. EIS GS00Q17NSD

13 General Services Administratin Netwrk Services 2020 Enterprise Infrastructure Slutins E E Test Scenari BSS-TS01: Direct Data Exchange BSS-TS01-01: XML ver Secure Web Services BSS-TS01: Direct Data Exchange BSS-TS01-01 Test Case Descriptin Gvernment Input(s) Data Set Descriptin XML ver Secure Web Services G J.2.9 N/A Prperly frmatted gvernment data set listed as using web services as the transfer mechanism in Sectin J.2 Prperly frmatted cntractr data set that meets the fllwing criteria: Listed as using web services as the transfer mechanism in Sectin J.2 Includes data derived frm the gvernment input Successful data transfer Crrect technical aspects Each gvernment-prvided test data set will include: One gvernment data set listed as using web services as the transfer mechanism in Sectin J.2 EIS GS00Q17NSD

14 General Services Administratin Netwrk Services 2020 Enterprise Infrastructure Slutins E Test Scenari BSS-TS01-02: PSV ver SFTP BSS-TS01: Direct Data Exchange BSS-TS01-02 Test Case Descriptin Gvernment Input(s) Data Set Descriptin PSV ver SFTP G J.2.9 N/A Prperly frmatted gvernment data set listed as using SFTP as the transfer mechanism in Sectin J.2 Prperly frmatted cntractr data set that meets the fllwing criteria: Listed as using SFTP as the transfer mechanism in Sectin J.2 Includes data derived frm the gvernment input Successful transfer f PSV data Crrect technical aspects Each gvernment-prvided test data set will include: One gvernment data set listed as using SFTP as the transfer mechanism in Sectin J.2 EIS GS00Q17NSD

15 General Services Administratin Netwrk Services 2020 Enterprise Infrastructure Slutins E Test Scenari BSS-TS01-03: Errr Handling: XML ver Secure Web Services BSS-TS01: Direct Data Exchange BSS-TS01-03 Test Case Descriptin Gvernment Input(s) Data Set Descriptin Errr Handling: XML ver Secure Web Services G J.2.9 N/A Invalid gvernment data set listed as using web services as the transfer mechanism in Sectin J.2 Ntificatin t cntractr f failed imprt Evidence f failure ntificatin N partial imprt Each gvernment-prvided test data set will include: One gvernment data set listed as using web services as the transfer mechanism in Sectin J.2 One r mre XML frmatting errrs (e.g. missing delimiters) EIS GS00Q17NSD

16 General Services Administratin Netwrk Services 2020 Enterprise Infrastructure Slutins E Test Scenari BSS-TS01-04: Errr Handling: PSV ver SFTP BSS-TS01: Direct Data Exchange BSS-TS01-04 Test Case Descriptin Gvernment Input(s) Data Set Descriptin Errr Handling: PSV ver SFTP G J.2.9 N/A Invalid gvernment data set listed as using SFTP as the transfer mechanism in Sectin J.2 Ntificatin t cntractr f failed imprt Evidence f failure ntificatin N partial imprt Each gvernment-prvided test data set will include: One gvernment data set listed as using SFTP as the transfer mechanism in Sectin J.2 One r mre frmatting errrs (e.g. missing delimiters) E BSS-TS02: Task Order Data Management E Test Scenari BSS-TS02-01: Direct Billing Accunt Setup BSS-TS02: Task Order and Accunt Management Setup BSS-TS02-01 Test Case Descriptin Gvernment Input(s) Data Set Descriptin Direct Billing Accunt Setup G.3 J.2.2 J.2.3 N/A Task rder cntrlled data as defined in Sectin J.2.3 Task rder assciated data as defined in Sectin J.2.3 System Reference data as defined in Sectin J.2.3 Direct Billed Agency Setup (DBAS) CDRL All required CDRLs as defined in Sectin J.2.3 Accurate data based n inputs Crrect technical aspects Each gvernment-prvided test data set will include: Sample TO cntrlled data transferred in the frm f a sample TO Sample TO assciated data transferred in free frmat (nt previusly defined) unless the cntractr specifies in their EIS GS00Q17NSD

17 General Services Administratin Netwrk Services 2020 Enterprise Infrastructure Slutins prpsal that custmer registratin is t be submitted via their web interface and that interface cllects all f the required data Sample System Reference data transferred using the mechanism specified in Sectin J.2 E Reserved E BSS-TS03: Rle Based Access Cntrl E Test Scenari BSS-TS03-01: Authrized User Access Verificatin BSS-TS03: Rle Based Access Cntrl BSS-TS03-01 Test Case Descriptin Gvernment Input(s) Data Set Descriptin Authrized User Access Verificatin G.5 J.2.3 TO cntrlled, TO assciated, and System Reference data laded int cntractr BSS User attempts t: Sign int BSS Access BSS areas t which they are an authrized user Exercise the full range f functinality (read/write) permitted fr their rle User is permitted t: Access t BSS Access BSS areas as authrized Exercise assigned functinality Access is granted N security errrs displayed Each gvernment-prvided test data set will include: Rle t be tested Functinality t be tested EIS GS00Q17NSD

18 General Services Administratin Netwrk Services 2020 Enterprise Infrastructure Slutins E Test Scenari BSS-TS03-02: Unauthrized User Access Denial Verificatin BSS-TS03: Rle Based Access Cntrl BSS-TS03-02 Test Case Descriptin Gvernment Input(s) Data Set Descriptin Unauthrized User Access Denial Verificatin G.5 J.2.3. TO cntrlled, TO assciated, and System Reference data laded int cntractr BSS User attempts t: Sign int BSS Access BSS areas t which they are nt an authrized user Exercise functinality (read/write) nt permitted fr their rle User is denied access at the pint apprpriate the rle, area and functinality specified in the test data set: Access t BSS Access t specific BSS areas Access t specific functinality User is shwn security errr message Access is denied Apprpriate errrs are displayed Each gvernment-prvided test data set will include: Rle t be tested (may be specified as nne if the set is intended t shw denial f unauthrized users) Functinality t be tested EIS GS00Q17NSD

19 General Services Administratin Netwrk Services 2020 Enterprise Infrastructure Slutins E BSS-TS04: Service Ordering E Test Scenari BSS-TS04-01: New Order via Web Interface BSS-TS04: Service Ordering BSS-TS04-01 Test Case Descriptin Gvernment Input(s) Data Set Descriptin New Order via Web Interface G.3 G J.2.4 TO cntrlled, TO assciated, and System Reference data laded int cntractr BSS Service Order (SO) with all required data elements as described in Sectin J Service Order ntificatin CDRLs as defined in Sectin J.2.4: Service Order Acknwledgment (SOA) Service Order Cnfirmatin (SOC) Firm Order Cmmitment Ntice (FOCN) Service Order Cmpletin Ntificatin (SOCN) All required CDRLs as defined in Sectin J.2.4 Accurate data based n inputs Crrect technical aspects Each gvernment-prvided test data set will include: A cmplete SO fr ne r mre services listed in Sectin C.2 f the cntract SO t be entered int the cntactr s BSS via the cntractr s web interface as described in Sectin G EIS GS00Q17NSD

20 General Services Administratin Netwrk Services 2020 Enterprise Infrastructure Slutins E Test Scenari BSS-TS04-02: New Order via BSS-TS04: Service Ordering BSS-TS04-02 Test Case Descriptin Gvernment Input(s) Data Set Descriptin New Order via G.3 G J.2.4 TO cntrlled, TO assciated, and System Reference data laded int cntractr BSS Service Order (SO) with all required data elements as described in Sectin J Service Order ntificatin CDRLs as defined in Sectin J.2.4: Service Order Acknwledgment (SOA) Service Order Cnfirmatin (SOC) Firm Order Cmmitment Ntice (FOCN) Service Order Cmpletin Ntificatin (SOCN) All required CDRLs as defined in Sectin J.2.4 Accurate data based n inputs Crrect technical aspects Each gvernment-prvided test data set will include: A cmplete SO fr ne r mre services listed in Sectin C.2 f the cntract SO submitted via a means listed in J.2.4 ther than the cntractr s web interface EIS GS00Q17NSD

21 General Services Administratin Netwrk Services 2020 Enterprise Infrastructure Slutins E Test Scenari BSS-TS04-03: Discnnect Order BSS-TS04: Service Ordering BSS-TS04-03 Test Case Descriptin Gvernment Input(s) Data Set Descriptin Discnnect Order G.3 J.2.4 J TO cntrlled, TO assciated, and System Reference data laded int cntractr BSS Previusly prvisined circuit r service element entered int the cntractr BSS Service Order (SO) with all required data elements as described in Sectin J.2.4 fr the discnnect f A circuit r service element (CLIN) A feature f a circuit r service element Service Order ntificatin CDRLs as defined in Sectin J.2.4: Service Order Acknwledgment (SOA) Service Order Cnfirmatin (SOC) Firm Order Cmmitment Ntice (FOCN) if required based n the requirements described in Sectin J.2.4 Service Order Cmpletin Ntificatin (SOCN) All required CDRLs Accurate data based n inputs Crrect technical aspects Each gvernment-prvided test data set will include: A cmplete SO fr the discnnect f a circuit r service element r a feature f a circuit r service element as described in Sectin G.3 and Sectin J EIS GS00Q17NSD

22 General Services Administratin Netwrk Services 2020 Enterprise Infrastructure Slutins E Test Scenari BSS-TS04-04: Feature Additin Order BSS-TS04: Service Ordering BSS-TS04-04 Test Case Descriptin Gvernment Input(s) Data Set Descriptin Feature Additin Order G.3 J.2.4 J TO cntrlled, TO assciated, and System Reference data laded int cntractr BSS Previusly prvisined circuit r service element entered int the cntractr BSS Service Order (SO) with all required data elements as described in Sectin J.2.4 fr the additin f a feature t a circuit r service element Service Order ntificatin CDRLs as defined in Sectin J.2.4: Service Order Acknwledgment (SOA) Service Order Cnfirmatin (SOC) Firm Order Cmmitment Ntice (FOCN) Service Order Cmpletin Ntificatin (SOCN) All required CDRLs Accurate data based n inputs Crrect technical aspects Each gvernment-prvided test data set will include: A cmplete SO fr the additin f a feature t a circuit r service element as described in Sectin G.3 and Sectin J EIS GS00Q17NSD

23 General Services Administratin Netwrk Services 2020 Enterprise Infrastructure Slutins E Test Scenari BSS-TS04-05: Mve Order BSS-TS04: Service Ordering BSS-TS04-05 Test Case Descriptin Gvernment Input(s) Data Set Descriptin Mve Order G.3 J.2.4 J TO cntrlled, TO assciated, and System Reference data laded int cntractr BSS Previusly prvisined circuit r service element entered int the cntractr BSS Tw Service Orders (SOs) that cmbine t specify the mve f a circuit r service element with all required data elements as described in Sectin J.2.4 One SO fr the discnnect f the circuit r service element at the ld lcatin Secnd SO fr the installatin f the identical circuit r service element at the new lcatin Service Order ntificatin CDRLs as defined in Sectin J.2.4: Service Order Acknwledgment (SOA) Service Order Cnfirmatin (SOC) Firm Order Cmmitment Ntice (FOCN) Service Order Cmpletin Ntificatin (SOCN) All required CDRLs Accurate data based n inputs Crrect technical aspects Each gvernment-prvided test data set will include: A pair f cmplete SOs fr the mve f a circuit r service element frm ne valid lcatin t anther as described in Sectin G.3 and Sectin J SO fr the discnnect frm the ld lcatin SO fr the installatin f the identical service at the new lcatin EIS GS00Q17NSD

24 General Services Administratin Netwrk Services 2020 Enterprise Infrastructure Slutins E Test Scenari BSS-TS04-06: TSP Order BSS-TS04: Service Ordering BSS-TS04-06 Test Case Descriptin Gvernment Input(s) Data Set Descriptin TSP Order G.3 J.2.4 TO cntrlled, TO assciated, and System Reference data laded int cntractr BSS Service Order (SO) requesting TSP with all required data elements as described in Sectin J.2.4 Service Order ntificatin CDRLs as defined in Sectin J.2.4: Service Order Acknwledgment (SOA) Service Order Cnfirmatin (SOC) Firm Order Cmmitment Ntice (FOCN) Service Order Cmpletin Ntificatin (SOCN) All required CDRLs as defined in Sectin J.2.4 Accurate data based n inputs Crrect technical aspects Each gvernment-prvided test data set will include: A cmplete SO with a TSP cde fr ne r mre services listed in Sectin C.2 f the cntract EIS GS00Q17NSD

25 General Services Administratin Netwrk Services 2020 Enterprise Infrastructure Slutins E Test Scenari BSS-TS04-07: Aut-Sld CLINs BSS-TS04: Service Ordering BSS-TS04-07 Test Case Descriptin Gvernment Input(s) Data Set Descriptin Aut-Sld CLINs G.3 J.2.4 TO cntrlled, TO assciated, and System Reference data laded int cntractr BSS Service Order (SO) that includes CLINS with assciated Aut-Sld CLINs and cntains all required data elements as described in Sectin J.2.4 Service Order ntificatin CDRLs as defined in Sectin J.2.4: Service Order Acknwledgment (SOA) Service Order Cnfirmatin (SOC) Firm Order Cmmitment Ntice (FOCN) Service Order Cmpletin Ntificatin (SOCN) All required CDRLs as defined in Sectin J.2.4 Accurate data based n inputs Crrect technical aspects Each gvernment-prvided test data set will include: A cmplete SO that includes Aut-Sld CLINs fr ne r mre services listed in Sectin C.2 f the cntract EIS GS00Q17NSD

26 General Services Administratin Netwrk Services 2020 Enterprise Infrastructure Slutins E Test Scenari BSS-TS04-08: Task Order Unique CLINs (TUCs) BSS-TS04: Service Ordering BSS-TS04-08 Test Case Descriptin Gvernment Input(s) Data Set Descriptin Task Order Unique CLINs (TUCs) G.3 J.2.4 TO setup data laded int cntractr BSS TO Data defines ne r mre TUCs Accunt Management data laded int cntractr BSS Service Order (SO) cntaining Task Order Unique CLINs (TUCs) and all required data elements as described in Sectin J.2.4 Service Order ntificatin CDRLs as defined in Sectin J.2.4: Service Order Acknwledgment (SOA) Service Order Cnfirmatin (SOC) Firm Order Cmmitment Ntice (FOCN) Service Order Cmpletin Ntificatin (SOCN) All required CDRLs as defined in Sectin J.2.4 Accurate data based n inputs Crrect technical aspects Each gvernment-prvided test data set will include: A cmplete SO cntaining Task Order Unique CLINs (TUCs) fr ne r mre services listed in Sectin C.2 f the cntract EIS GS00Q17NSD

27 General Services Administratin Netwrk Services 2020 Enterprise Infrastructure Slutins E Reserved E BSS-TS04-10: Bulk Orders Test Scenari Test Case Descriptin Gvernment Input(s) Data Set Descriptin BSS-TS04: Service Ordering BSS-TS04-10 Bulk Orders G.3 J.2.4 TO cntrlled, TO assciated, and System Reference data laded int cntractr BSS Bulk Service Order (SO) with all required data elements as described in Sectin J.2.4 Service Order ntificatin CDRLs as defined in Sectin J.2.4: Service Order Acknwledgment (SOA) Service Order Cnfirmatin (SOC) Firm Order Cmmitment Ntice (FOCN) Service Order Cmpletin Ntificatin (SOCN) All required CDRLs as defined in Sectin J.2.4 Accurate data based n inputs Crrect technical aspects Each gvernment-prvided test data set will include: A SO including at least 20 line items fr services listed in Sectin C.2 f the cntract SO data prvided via a delimited text file r MS Excel file EIS GS00Q17NSD

28 General Services Administratin Netwrk Services 2020 Enterprise Infrastructure Slutins E BSS-TS04-11: Errr Checking: Missing Inf Test Scenari Test Case Descriptin Gvernment Input(s) Data Set Descriptin BSS-TS04: Service Ordering BSS-TS04-11 Errr Checking: Missing Infrmatin G.3 J.2.4 TO cntrlled, TO assciated, and System Reference data laded int cntractr BSS Service Order (SO) missing ne r mre required data elements as described in Sectin J.2.4 Service Order ntificatin CDRLs as defined in Sectin J.2.4: Service Order Acknwledgment (SOA) Service Order Rejectin Ntice (SORN) All required CDRLs Accurate data based n inputs Crrect technical aspects Each gvernment-prvided test data set will include: SO missing ne r mre required data elements fr ne r mre services listed in Sectin C.2 f the cntract EIS GS00Q17NSD

29 General Services Administratin Netwrk Services 2020 Enterprise Infrastructure Slutins E BSS-TS04-12: Errr Checking: Invalid Inf Test Scenari Test Case Descriptin Gvernment Input(s) Data Set Descriptin BSS-TS04: Service Ordering BSS-TS04-12 Errr Checking: Invalid Inf G.3 J.2.4 TO cntrlled, TO assciated, and System Reference data laded int cntractr BSS Service Order (SO) with ne r mre invalid data elements as described in Sectin J.2.4 Service Order ntificatin CDRLs as defined in Sectin J.2.4: Service Order Acknwledgment (SOA) Service Order Rejectin Ntice (SORN) All required CDRLs Accurate data based n inputs Crrect technical aspects Each gvernment-prvided test data set will include: SO rders with ne r mre invalid data infrmatin fr ne r mre services listed in Sectin C.2 f the cntract Invalid data can include imprperly frmatted data r data that is incnsistent with the TO r Accunt Management data EIS GS00Q17NSD

30 General Services Administratin Netwrk Services 2020 Enterprise Infrastructure Slutins E BSS-TS05: Supplements t In-Prgress Orders E Test Scenari BSS-TS05-01: Cancel Orders BSS-TS05: Supplements t In-Prgress Orders BSS-TS05-01 Test Case Descriptin Gvernment Input(s) Data Set Descriptin Cancel Orders G.3 J.2.4 J TO cntrlled, TO assciated, and System Reference data laded int cntractr BSS Service Order (SO) with all required data elements as described in Sectin J.2.4 Service Order (SO) fr a cancellatin f the previus rder with all required data elements as described in Sectin J.2.4 issued prir t cmpletin f the previus rder Service Order ntificatin CDRLs as defined in Sectin J.2.4: Service Order Acknwledgment (SOA) Updates t Service Order Cnfirmatin (SOC) if required Updates t Firm Order Cmmitment Ntice (FOCN) if required Service Order Cmpletin Ntificatin (SOCN) All required CDRLs Accurate data based n inputs Crrect technical aspects Each gvernment-prvided test data set will include: A cmplete SO fr ne r mre services listed in Sectin C.2 f the cntract A secnd SO canceling the first Service Order as defined in Sectin J The Cancel Order may be issued befre r after the deadline described in Sectin G.3 EIS GS00Q17NSD

31 General Services Administratin Netwrk Services 2020 Enterprise Infrastructure Slutins E Test Scenari BSS-TS05-02: Service Feature Change BSS-TS05: Supplements t In-Prgress Orders BSS-TS05-02 Test Case Descriptin Gvernment Input(s) Data Set Descriptin Service Feature Change G.3 J.2.4 J TO cntrlled, TO assciated, and System Reference data laded int cntractr BSS Service Order (SO) with all required data elements as described in Sectin J.2.4 Service Order (SO) fr a service feature change t the previus rder with all required data elements as described in Sectin J.2.4 issued prir t cmpletin t previus rder Service Order ntificatin CDRLs as defined in Sectin J.2.4: Service Order Acknwledgment (SOA) Updates t Service Order Cnfirmatin (SOC) if required Updates t Firm Order Cmmitment Ntice (FOCN) if required Service Order Cmpletin Ntificatin (SOCN) All required CDRLs Accurate data based n inputs Crrect technical aspects Each gvernment-prvided test data set will include: A cmplete SO fr ne r mre services listed in Sectin C.2 f the cntract A secnd SO describing a service feature change t the first Service Order as defined in Sectin J EIS GS00Q17NSD

32 General Services Administratin Netwrk Services 2020 Enterprise Infrastructure Slutins E Test Scenari BSS-TS05-03: Lcatin Change BSS-TS05: Supplements t In-Prgress Orders BSS-TS05-03 Test Case Descriptin Gvernment Input(s) Data Set Descriptin Lcatin Change G.3 J.2.4 J TO cntrlled, TO assciated, and System Reference data laded int cntractr BSS Service Order (SO) with all required data elements as described in Sectin J.2.4 Service Order (SO) fr a lcatin change t the previus rder with all required data elements as described in Sectin J.2.4 issued prir t cmpletin t previus rder Service Order ntificatin CDRLs as defined in Sectin J.2.4: Service Order Acknwledgment (SOA) Updates t Service Order Cnfirmatin (SOC) if required Updates t Firm Order Cmmitment Ntice (FOCN) if required Service Order Cmpletin Ntificatin (SOCN) All required CDRLs Accurate data based n inputs Crrect technical aspects Each gvernment-prvided test data set will include: A cmplete SO fr ne r mre services listed in Sectin C.2 f the cntract A secnd SO describing a lcatin change t the first Service Order as defined in Sectin J EIS GS00Q17NSD

33 General Services Administratin Netwrk Services 2020 Enterprise Infrastructure Slutins E Test Scenari BSS-TS05-04: Change t Custmer Want Date BSS-TS05: Supplements t In-Prgress Orders BSS-TS05-04 Test Case Descriptin Gvernment Input(s) Data Set Descriptin Change t Custmer Want Date G.3 J.2.4 J TO cntrlled, TO assciated, and System Reference data laded int cntractr BSS Service Order (SO) with all required data elements as described in Sectin J.2.4 Service Order (SO) fr a change t the Custmer Want Date fr the previus rder with all required data elements as described in Sectin J.2.4 issued prir t cmpletin f the previus rder Service Order ntificatin CDRLs as defined in Sectin J.2.4: Service Order Acknwledgment (SOA) Updates t Service Order Cnfirmatin (SOC) if required Updates t Firm Order Cmmitment Ntice (FOCN) if required Service Order Cmpletin Ntificatin (SOCN) All required CDRLs Accurate data based n inputs Crrect technical aspects Each gvernment-prvided test data set will include: A cmplete SO fr ne r mre services listed in Sectin C.2 f the cntract A secnd SO describing a change t the Custmer Want Date fr the first Service Order as defined in Sectin J The Custmer Want Date Change Order may be issued befre r after the deadline described in Sectin G.3 EIS GS00Q17NSD

34 General Services Administratin Netwrk Services 2020 Enterprise Infrastructure Slutins E Test Scenari BSS-TS05-05: Change t Administrative Data BSS-TS05: Supplements t In-Prgress Orders BSS-TS05-05 Test Case Descriptin Gvernment Input(s) Data Set Descriptin Change t Administrative Data G.3 J.2.4 J TO cntrlled, TO assciated, and System Reference data laded int cntractr BSS Service Order (SO) with all required data elements as described in Sectin J.2.4 Service Order (SO) fr a change t the administrative data fr the previus rder with all required data elements as described in Sectin J.2.4 issued prir t cmpletin f the previus rder Service Order ntificatin CDRLs as defined in Sectin J.2.4: Service Order Acknwledgment (SOA) Updates t Service Order Cnfirmatin (SOC) if required Updates t Firm Order Cmmitment Ntice (FOCN) if required Service Order Cmpletin Ntificatin (SOCN) All required CDRLs Accurate data based n inputs Crrect technical aspects Each gvernment-prvided test data set will include: A cmplete SO fr ne r mre services listed in Sectin C.2 f the cntract A secnd SO describing a change t the administrative data fr the first Service Order as defined in Sectin J EIS GS00Q17NSD

35 General Services Administratin Netwrk Services 2020 Enterprise Infrastructure Slutins E BSS-TS06: Administrative Change Orders E Test Scenari BSS-TS06-01: Administrative Change Order BSS-TS06: Administrative Change Order BSS-TS06-01 Test Case Descriptin Gvernment Input(s) Data Set Descriptin Administrative Change Order G.3 J.2.4 TO cntrlled, TO assciated, and System Reference data laded int cntractr BSS One r mre previusly prvisined rders Administrative Change Order that specifies a change t the administrative data assciated with a previusly prvisined service as described in Sectin G.3 Service Order ntificatin CDRLs as defined in Sectin J.2.4: Service Order Administrative Change (SOAC) All required CDRLs Accurate data based n inputs Crrect technical aspects Each gvernment-prvided test data set will include: A cmplete administrative change rder fr a change t the administrative data fr a previusly prvisined service as described in Sectin G.3 EIS GS00Q17NSD

36 General Services Administratin Netwrk Services 2020 Enterprise Infrastructure Slutins E BSS-TS07: Rapid Prvisining & Self-Prvisining Orders E Test Scenari BSS-TS07-01: Rapid Prvisining Orders BSS-TS07: Rapid Prvisining & Self-Prvisining Orders BSS-TS07-01 Test Case Descriptin Gvernment Input(s) Data Set Descriptin Rapid Prvisining Orders G.3 G J.2.4 TO cntrlled, TO assciated, and System Reference data laded int cntractr BSS Service Order (SO) fr ne r mre services subject t rapid prvisining as defined in Sectin G.3 with all required data elements as described in Sectin J.2.4 Service Order ntificatin CDRLs as defined in Sectin J.2.4: Service Order Acknwledgment (SOA) if prvisining requires mre than 24 hurs Service Order Cmpletin Ntificatin (SOCN) All required CDRLs as defined in Sectin J.2.4 Accurate data based n inputs Crrect technical aspects Each gvernment-prvided test data set will include: A cmplete SO fr ne r mre services subject t rapid prvisining as defined in Sectin G.3 EIS GS00Q17NSD

37 General Services Administratin Netwrk Services 2020 Enterprise Infrastructure Slutins E Test Scenari BSS-TS07-02: Self-Prvisining Orders BSS-TS07: Rapid Prvisining & Self-Prvisining Orders BSS-TS07-02 Test Case Descriptin Gvernment Input(s) Data Set Descriptin Self-Prvisining Orders G.3 G J.2.4 TO cntrlled, TO assciated, and System Reference data laded int cntractr BSS Service Order (SO) with all required data elements as described in Sectin J.2.4 fr ne r mre services that are: Subject t rapid prvisining as defined in Sectin G.3 Available fr self-prvisining as defined in Sectin G.3 and Sectin C.2 Service Order ntificatin CDRLs as defined in Sectin J.2.4: Service Order Acknwledgment (SOA) if prvisining requires mre than 24 hurs Service Order Cmpletin Ntificatin (SOCN) All required CDRLs as defined in Sectin J.2.4 Accurate data based n inputs Crrect technical aspects Each gvernment-prvided test data set will include: Service Order (SO) with all required data elements as described in Sectin J.2.4 fr ne r mre services that are subject t rapid prvisining as defined in Sectin G.3 and that are available fr self-prvisining as defined in Sectin G.3 and Sectin C.2 EIS GS00Q17NSD

38 General Services Administratin Netwrk Services 2020 Enterprise Infrastructure Slutins E Test Scenari BSS-TS07-03: Self-Prvisining Orders: Errr Checking BSS-TS07: Rapid Prvisining & Self-Prvisining Orders BSS-TS07-03 Test Case Descriptin Gvernment Input(s) Data Set Descriptin Self-Prvisining Orders: Errr Checking G.3 G J.2.4 TO cntrlled, TO assciated, and System Reference data laded int cntractr BSS Service Order (SO) fr ne r mre services subject t rapid prvisining as defined in Sectin G.3 and available fr selfprvisining Ppulated via Cntractrs Prtal with ne r mre missing r invalid data elements as described in Sectin J.2.4 Service Order ntificatin CDRLs as defined in Sectin J.2.4 Service Order Rejectin Ntice (SORN) User is shwn errr message indicating failure All required CDRLs as defined in Sectin J.2.4 Accurate data based n inputs Crrect technical aspects Apprpriate errrs are displayed Each gvernment-prvided test data set will include: Service Order (SO) with all required data elements as described in Sectin J.2.4 fr ne r mre services that are subject t rapid prvisining as defined in Sectin G.3 and that are available fr self-prvisining as defined in Sectin G.3 and Sectin C.2 SO t be prvided via Cntractrs Prtal EIS GS00Q17NSD

39 General Services Administratin Netwrk Services 2020 Enterprise Infrastructure Slutins E BSS-TS08: Inventry and Billing E Test Scenari BSS-TS08-01: Inventry Recnciliatin BSS-TS08: Inventry and Billing BSS-TS08-01 Test Case Descriptin Gvernment Input(s) Data Set Descriptin Inventry Recnciliatin G.7 J.2.7 TO cntrlled, TO assciated, and System Reference data laded int cntractr BSS One r mre previusly prvisined rders N/A Inventry Recnciliatin (IR) CDRLs as described in Sectin J.2.7 All required CDRLs Accurate data based n inputs Crrect technical aspects N/A, see EIS GS00Q17NSD

40 General Services Administratin Netwrk Services 2020 Enterprise Infrastructure Slutins E Test Scenari BSS-TS08-02: Billing BSS-TS08: Inventry and Billing BSS-TS08-02 Test Case Descriptin Gvernment Input(s) Data Set Descriptin Billing J.2.5 J.2.10 TO cntrlled, TO assciated, and System Reference data laded int cntractr BSS One r mre previusly prvisined rders N/A Billing CDRLs as defined in Sectin J.2.4: Billing Invice (BI) Tax Detail Reprt (TAX) Assciated Gvernment Fee Detailed (AGFD) AGF EFT Reprt (ATR) All required CDRLs Accurate data based n inputs Crrect technical aspects CDRLs are internally cnsistent Cmplies with calculatin rules N/A, see EIS GS00Q17NSD

41 General Services Administratin Netwrk Services 2020 Enterprise Infrastructure Slutins E Test Scenari BSS-TS08-03: Usage Based Billing BSS-TS08: Inventry and Billing BSS-TS08-03 Test Case Descriptin Gvernment Input(s) Data Set Descriptin Usage Based Billing G.3 J.2.4 TO cntrlled, TO assciated, and System Reference data laded int cntractr BSS One r mre previusly usage based prvisined rders Sample usage data fr ne r mre UBI based n Usage Based CLIN(s) Billing CDRLs as defined in Sectin J.2.4: Billing Invice (BI) Tax Detail Reprt (TAX) Assciated Gvernment Fee Detailed (AGFD) AGF EFT Reprt (ATR) All required CDRLs Accurate data based n inputs Crrect technical aspects CDRLs are internally cnsistent Cmplies with calculatin rules Each gvernment-prvided test data set will include: Sample usage data fr ne r mre UBI based n Usage Based CLIN(s) See als EIS GS00Q17NSD

42 General Services Administratin Netwrk Services 2020 Enterprise Infrastructure Slutins E Test Scenari BSS-TS08-04: Billing Adjustments BSS-TS08: Inventry and Billing BSS-TS08-04 Test Case Descriptin Gvernment Input(s) Data Set Descriptin Billing Adjustments G.4 J.2.5 TO cntrlled, TO assciated, and System Reference data laded int cntractr BSS One r mre previusly prvisined rders At least ne previusly submitted Billing Invice (BI) Sample adjustment request t change r mdify a billing line item Billing Adjustment (BA) as defined in Sectin J.2.5: Reflects requested adjustment All required CDRLs Accurate data based n inputs Crrect technical aspects Each gvernment-prvided test data set will include: Sample adjustment request t change r mdify a billing line item EIS GS00Q17NSD

43 General Services Administratin Netwrk Services 2020 Enterprise Infrastructure Slutins E BSS-TS09: Dispute Handling E Test Scenari BSS-TS09-01: Gvernment Initiated Dispute BSS-TS09: Dispute Handling BSS-TS09-01 Test Case Descriptin Gvernment Input(s) Data Set Descriptin Gvernment Initiated Dispute J.2.3 J TO cntrlled, TO assciated, and System Reference data laded int cntractr BSS One r mre previusly prvisined rders At least ne previusly submitted Billing Invice (BI) Gvernment issues at least 2 Disputes (D) as defined in Sectin J.2.6 Ntificatin t clse a dispute after first Dispute Reprt is issued (see expected utputs) Dispute Reprt (DR) Reflects pen Disputes A secnd Dispute Reprt (DR) Reflects pen and clsed Disputes All required CDRLs Accurate data based n inputs Crrect technical aspects Each gvernment-prvided test data set will include: At least tw Disputes (D) Ntificatin t clse ne r mre disputes EIS GS00Q17NSD

44 General Services Administratin Netwrk Services 2020 Enterprise Infrastructure Slutins E BSS-TS10: SLA Management E BSS-TS10-01: SLA Reprting Test Scenari Test Case Descriptin Gvernment Input(s) Data Set Descriptin BSS-TS10: SLA Management BSS-TS10-01 SLA Reprting G.3 J.2.4 TO cntrlled, TO assciated, and System Reference data laded int cntractr BSS One r mre previusly prvisined rders Services t shw as SLAs met r missed SLA Reprt (SLAR) All required CDRLs Accurate data based n inputs Crrect technical aspects Services by UBI t shw as SLAs met r missed EIS GS00Q17NSD

45 General Services Administratin Netwrk Services 2020 Enterprise Infrastructure Slutins E BSS-TS10-02: SLA Credit Request Test Scenari Test Case Descriptin Gvernment Input(s) Data Set Descriptin BSS-TS10: SLA Management BSS-TS10-02 SLA Credit Request G.3 J.2.4 J TO cntrlled, TO assciated, and System Reference data laded int cntractr BSS One r mre previusly prvisined rders At least ne previusly submitted Billing Invice (BI) SLA Reprt with at least ne SLA missed SLA Credit Request (SLACR) SLA Credit Request Respnse All required CDRLs Each CDRL meets requirements Each gvernment-prvided test data set will include: SLA Credit Request EIS GS00Q17NSD

46 General Services Administratin Netwrk Services 2020 Enterprise Infrastructure Slutins E BSS-TS11: Open-Frmat Reprting E BSS-TS11-01: Open-Frmat Reprting: Samples Test Scenari Test Case Descriptin Gvernment Input(s) Data Set Descriptin BSS-TS11-01: Open-Frmat Reprting BSS-TS11-01 Open-Frmat Reprting: Samples G.4 G.5 J J J N/A N/A Sample cpies f the cntractr s standard reprts fr: Mnthly Billing Infrmatin Memrandum Truble Management Incident Perfrmance Reprt Describes service utage r degradatin that are user initiated and/r autmated mnitring created reprts Truble Management Perfrmance Summary Reprt Each CDRL meets requirements N/A EIS GS00Q17NSD

47 General Services Administratin Netwrk Services 2020 Enterprise Infrastructure Slutins E BSS-TS12: Regressin Testing E BSS-TS12-01: Regressin Testing Test Scenari Test Case Descriptin Nte BSS-TS12: Regressin Testing BSS-TS12-01 Regressin Testing: Test Cases TBD G.5.5 Cntractr BSS has cmpleted Develpment testing and ATO Inputs, utputs, acceptance criteria and datasets t be determined based n Change Management prvided in G.5.5 Additinal test cases may be defined as needed EIS GS00Q17NSD

48 General Services Administratin Netwrk Services 2020 Enterprise Infrastructure Slutins E BSS-TS13: Security Testing E BSS-TS13-01: Security Testing Test Scenari Test Case Descriptin Gvernment Input(s) Data Set Descriptin BSS-TS13: Security Testing BSS-TS13-01 Security Testing G.5.6 Defined in Sectin G.5.6 and references therein Defined in Sectin G.5.6 and references therein Defined in Sectin G.5.6 and references therein Cntractr BSS receives ATO Defined in Sectin G.5.6 and references therein EIS GS00Q17NSD

49 General Services Administratin Netwrk Services 2020 Enterprise Infrastructure Slutins E Test Results The cntractr shall demnstrate that it successfully meets the BSS acceptance criteria fr the varius test scenaris/test cases defined in Sectins E and E The cntractr shall prvide test results that will prvide details f testing the fllwing: Functinal requirements fr the Ordering, Billing, Inventry Management, Disputes, SLA Management and truble ticketing prcesses as described in Sectin G and Sectin J.2. System t system data exchange mechanism requirements defined in Sectin G.5 fr each CDRLs defined in Sectin J.2. Crrect CDRLs are used in the data exchange. Mandatry data elements fr each CDRL defined in Sectin J.2.10 Data Dictinary are ppulated and accurate. Available ptinal data elements fr each CDRL defined in Sectin J.2.10 Data Dictinary are ppulated and accurate. Timely and successful system t system data exchange t meet defined perfrmance SLAs and prvisining intervals. The test results shall detail at a minimum the fllwing: Test scenari # / Test case # / Test Data Set # / Test #; Date f Test perfrmed,, Test Result (Pass/Fail), etc. EIS GS00Q17NSD

50 General Services Administratin Netwrk Services 2020 Enterprise Infrastructure Slutins E Deliverables E Verificatin Test Plan fr Cntractr s BSS The cntractr shall submit a BSS Verificatin Test Plan (BSS Test Plan) based n the fllwing timeline: Draft: with prpsal Final: 30 days after NTP Revisins: 14 days after receipt f gvernment cmments The BSS Test Plan shall: Reflect the test methdlgy defined in Sectin E.2.1. Include the cntractr s apprach t testing each test scenari and test case Include the cntractr s timeline and test sequencing EIS GS00Q17NSD

51 General Services Administratin Netwrk Services 2020 Enterprise Infrastructure Slutins E.2.2 EIS Services Verificatin Testing The cntractr shall prvide an EIS Services Verificatin Test Plan (EIS Test Plan) based n the test methdlgy defined in this sectin(test scenaris, test cases, test data sets, acceptance criteria) in respnse t the RFP fr each f the prpsed EIS services. E General Testing Requirements The cntractr shall meet the fllwing EIS Services testing requirements: Prvide a verificatin and acceptance testing apprach fr all awarded EIS services defined in Sectin C.2. Develp an EIS Test Plan that includes, but is nt limited t: The test methdlgy fr each EIS Service with test cases that will define the parameters t be measured, the measurement prcedure, and the acceptance (pass/fail) criteria. Fallback apprach t describe the fallback prcess and prcedures in case f testing failure. An EIS Test Plan shall be required fr all new services during the life f the cntract. Identificatin f any services frm Sectin C.2 t which testing is nt applicable. The fllwing cnditins als apply: E An agency may define additinal testing in the TO. The cntractr shall allw gvernment representative(s) t bserve all r any part f the EIS services verificatin testing. The cntractr shall prvide all necessary test equipment: data terminals, lad bxes, test cables, and any ther hardware and sftware required fr testing. Test Scenaris The EIS Test Plan shall include, but nt be limited t, the fllwing test scenaris: EIS GS00Q17NSD

52 General Services Administratin Netwrk Services 2020 Enterprise Infrastructure Slutins E EIS Services Verificatin Test Scenaris Test Scenari # RFP Sec # Descriptin Service TS-01 C.2 Service TS-02 G.8 Demnstrate that the cntractr s Clud Services is cmpliant with Federal Risk and Authrizatin Management Prgram (FedRAMP) requirements as defined. NIST.gv publicatins ments/minutes/ /ispab_june2013_gdrich.pdf Demnstrate that awarded services are delivered based n the KPIs and SLAs defined. The cntractr shall prvide FedRAMP certificatin and ensure that it is verified and accepted by GSA. The cntractr shall demnstrate that the service wrks prperly accrding t KPIs defined in Sectin C.2. Service TS-03 C Verificatin Testing f Dark Fiber Services See Sectin C fr acceptance criteria E Test Cases The cntractr shall prvide test cases fr each f the test scenaris defined in Sectin E The test cases will be defined in the EIS Test Plan. E Test Data Sets The cntractr shall successfully test all f the test cases defined in the EIS Test Plan using ne r mre test data sets prpsed by the cntractr. The cntractr shall test all services and service features prpsed at the TO. The cntractr shall use test data sets that reflect real-wrld service cnditins and lcatins and shall address all relevant test cases. E Test Results and Acceptance The cntractr shall prvide an EIS Services Verificatin Testing Reprt (EIS Testing Reprt) that shws successful cmpletin f testing defined in the EIS Test Plan. The cntractr shall cmplete verificatin and acceptance testing based n the acceptance criteria defined in the gvernment accepted EIS Test Plan. Acceptance shall include gvernment cmpliance requirements such as FedRAMP fr clud services, and the EIS GS00Q17NSD

53 General Services Administratin Netwrk Services 2020 Enterprise Infrastructure Slutins ATO fr FISMA related security requirements fr EIS services. The cntractr shall prvide the fllwing in rder fr the gvernment t apprve the test results: FedRAMP certificatin if clud services are included in the TO. EIS Testing Reprt shwing that each service prvisined wrks prperly accrding t the KPIs defined in Sectin C.2 and the acceptance criteria defined in the EIS Test Plan. Once verificatin testing is cmpleted successfully the gvernment may cmplete acceptance testing based n the acceptance criteria defined in the EIS Test Plan. The acceptance test will verify satisfactry end-t-end service perfrmance and prper peratin f all rdered features and functins. Perfrmance will be cnsidered satisfactry when services, equipment, systems and their assciated features and functins perfrm as specified in the cntract and TO. The cntractr may nt assign an effective billing date t an EIS Service until the agency accepts it in accrdance with the agreed-upn acceptance testing prcedures described in the EIS Test Plan. The gvernment reserves the right t perfrm additinal tests t cnfirm prper peratin f a delivered EIS service as defined by the TO. If the gvernment des nt reprt a prblem t the cntractr during this test perid, the effective billing date will be the cmpletin date n the SOCN. The cntractr shall nt begin billing fr services if the gvernment rejects the services within three (3) days f receipt f the SOCN. A lnger perid fr test and acceptance may be specified in the TO. The cntractr shall issue a new SOCN fr services after crrecting the reasns fr rejectin. The service will be cnsidered accepted if the gvernment des nt reject the service within the acceptance perid defined abve. If the gvernment rejects the service, it may at its ptin: 1. Direct the cntractr t repeat the prcedure utlined abve; 2. Withdraw the service frm acceptance testing; 3. Direct the cntractr t facilitate the return f the services t their riginal prvider (fr services transitined r migrated frm anther cntractr s netwrk); 4. Request a replacement f the service (in whle r in part); r 5. Cancel the service rder withut penalty. If the gvernment exercises any f these ptins as a cnsequence f unacceptable acceptance testing results, all expenses incurred by the gvernment shall be brne by the cntractr. If the gvernment elects ptin 1 abve, the cntractr shall immediately initiate crrective actins t remedy the prblem reprted n the truble ticket and shall keep EIS GS00Q17NSD

54 General Services Administratin Netwrk Services 2020 Enterprise Infrastructure Slutins the gvernment infrmed f prgress. In such cases, the gvernment reserves the right t exercise ptin 2, 3, 4 r 5 at any time. If the gvernment elects any f the ptins abve ther than ptin 1, all expenses incurred by the gvernment, including recurring charges and nn-recurring charges (NRC) t return services t the previus netwrk cnfiguratin, shall be brne by the cntractr. In cases when the gvernment cannt successfully cmplete acceptance testing due t circumstances beynd the cntrl f the cntractr, the cntractr shall ntify gvernment f the details surrunding the deficiencies and the steps the cntractr has taken t vercme the deficiencies. These cases shall be discussed between the gvernment and the cntractr. On a case-by-case basis, the GSA CO r the OCO may chse t waive the acceptance testing r extend the testing perid. Waiver f the acceptance testing may be cnsidered in thse instances when the cntractr has demnstrated that the prblems encuntered are nt the fault f the cntractr and gvernment has determined that the cntractr has taken all reasnable actins t crrect all prblems. The waiver issued by the GSA CO r the OCO will specify the grunds fr the waiver. If the waiver is nt granted, the cntractr shall be bligated t cntinue t attempt crrectin f the deficiencies encuntered in rder t successfully accmplish the acceptance testing. E Deliverables The cntractr shall prvide an EIS Test Plan in its prpsal that describes the testing f EIS Services based n test methdlgy described in Sectins E E Updates shall be submitted fr any new services that are added t the cntract with the mdificatin prpsal. The cntractr shall prvide an EIS Testing Reprt as defined in Sectin E within 3 days f service installatin and testing. EIS GS00Q17NSD