Maryland Health Benefit Exchange: Independent Verification and Validation (IV&V) Services Public Summary

Transcription

1 Maryland Health Benefit Exchange: Independent Verification and Validation (IV&V) Services Public Summary Angarai International Monthly IV&V Report Report Month: September 2014 Delivery Date: October 15, 2014 A service of Maryland Health Benefit Exchange

2 Summary of September Findings 17% System Changes Immovable Deadline Transfer System 1. The timelines are compressed and the deadlines are fixed, as they are mandated by 2015 Open Enrollment. 2. The system functions in Production today. Only a small percentage of the system (Deloitte Reports 17%) is being modified for changes required by the state of Maryland. 3. Program deliverables (CMS and system), training materials, marketing materials (website), project schedules, timelines, and task lists, and test cases / plans have been transferred from Connecticut to Maryland and serve as the basis for the system implementation documentation. September Reporting Activities and Findings Because of the unique nature of the project a transfer system only a small percentage of which is being modified for Open Enrollment Angarai placed its attention to detail on the Project Management structures and oversight methodologies /techniques that the Maryland Health Benefit Exchange (MHBE) PMO had put into place. Angarai evaluated vendor management, and vendor performance. 2

3 IV&V Findings September 2014 September 2014 Digging Deeper For the September IV&V report, the objective was to continue to monitor the Project Management Controls, vendor progress, and testing. Angarai had one new recommendation in the area of communication. Control In Place In Use Effective Adhering to Best Practices IV&V Recommendation Vendor Management / Program Governance Clear Lines of Authority Project Management Monitoring Controls Program-wide Risk and Issue Management Standard Communication and Meetings Management of Development / SDLC Organizational Change Management / Training Management of Critical Path Activities and Milestone Tracking Management of the Integrated Program Schedule Control and Oversight of Agreed-Upon Program Scope Test Planning and Defect Management 3

4 IV&V Findings September 2014 IV&V Finds: NEW: MHBE is actively performing performance testing. NEW: Xerox delivers Exceptional value and support. NEW: MHBE has Robust Incident Management, helpdesk and Go-Live Planning Monitoring: The MHBE PMO continues to be mature organization. The PMO has controls in place and is utilizing them fully. Vendor oversight and performance and contract management is continuous and thorough. Monitoring: MHBE PMO continues to operates in recognized Industry Standards Monitoring: Organizational and Business Process Change Management activities are key contributors to project success. The MHBE PMO has dedicated considerable resources to OCM to support the system so workers are trained and new processes are instituted to make their work more efficient. Monitoring: Deloitte health plan Carrier Management continues to be on track. Monitoring: Xerox plan for the Production data center is robust and comprehensive. Monitoring: CMS and MHBE communicate well and have good relations. CMS is supportive of MHBE and the project. Monitoring: Critical project milestones are constantly evaluated for dependencies and cross-team/ vendor impacts Monitoring: Project Status communications are Frequent, thorough and timely. 4

5 IV&V Recommends September 2014 Deloitte and Xerox need a RACI chart Updated. IVV Recommended - MHBE PMO formalize the roles and responsibilities of the two vendors in a RACI (responsible, accountable, consulted, informed) matrix. As of the September report, the MHBE PMO staff has created a draft RACI matrix. MHBE would benefit from a Portfolio Management tool. - Updated. IV&V Recommended the MHBE PMO s may benefit from investment in a Portfolio Management (PPM) tool. MHBE is considering tools, but has determined any implementation would occur post go-live. Deloitte does not always coordinate effectively with other vendors and MHBE. IVV Recommends - Angarai recommends that Deloitte Executive Management bring the right resources from across the firm and be receptive to expertise from other Vendors and MHBE. Deloitte Staffing fluctuates and changes are not always communicated timely. IVV Recommends - Deloitte provide suggested staffing roll-offs to MHBE in writing no less than 15 days in advance for MHBE approval. Deloitte Staffing fluctuates and changes are not always communicated timely. IVV Recommends Deloitte provide suggested staffing roll-offs to MHBE in writing no less than 15 days in advance for MHBE approval. 5

6 Thank you!