HL7 Conformance Testing

Transcription

1 Powerful Results. Delivered. HL7 Conformance Testing Developer's Integration Lab DIL Overview February 24,

2 Introduction AEGIS has been supporting testing within the HIT space with VA/HHS (ONC). HHS/ONC Nationwide Health Information Exchange (NwHIN) Healtheway Compliance Testing Body (CTB) Certification process for the ehealth Exchange OSEHRA Open Source Interoperability Work Group with a focus project of the DIL. NIST HITECH Award HITTI 2

3 Challenges Definition of Interoperability (let s agree to use IEEE). HIE Participants and Systems Not Ready for Certification Self-Attestation Understanding the Standards and Specifications Common (or Consensus based) Interpretation. Conformance vs Interoperability Syntactic vs Semantic Interoperability Interoperability vs Continuous Interoperability 3

4 State of Maturity of HIT Standards Objective: Adherence to a Standard can be demonstrated thru implementation & testing 4

5 State HIE Patient Info (SUT) 5

6 Developers Integration Lab Developers Integration Lab (DIL) o Cloud based solution (TaaS) o Global accessibility 24x7x365 days o Self Service Bi-Direction message based test lab o Beyond Happy Path 70% Negative testing o Conformance & Interoperability 6

7 DIL Test Account 7

8 DIL Test Scenario/Case 8

9 DIL Test Results 9

10 DIL Exception Reporting 10 AEGIS.net, Inc. - Powerful Results. Delivered.SM

11 DIL Message Debugging 11 AEGIS.net, Inc. - Powerful Results. Delivered.SM

12 DIL Test History 12 AEGIS.net, Inc. - Powerful Results. Delivered.SM

13 DIL Role Based Features Developers Integration Lab (DIL) Test Users / Participants Test Case Developers Test Rules Engine Community Representatives Certification / Test Validation DIL Administrator 13

14 Standards view thru Statistics ,387 Implemented Test Cases*: NwHIN Specification Patient Discovery Query for Documents Retrieve Document ,113 Test Cases for NwHIN specifications Totals Conformance Rules applying over 36,000 checkpoints. Over 77,391 Test Case Executions starting in April 2013 By Healtheway's CTB candidate participants and vendors. The DIL is Actively Exercising Health IT Standards. *ONC S&I Framework ARRA project

15 DIL Statistics More than 173 Organizations Registered on the DIL to test 35 active Healtheway 2014 onboarding candidates (through Sept.) Key Findings: Healtheway 2013 Onboarding Candidates Product Vendors 8 HIE Participants 14 Federal Agencies 3 1. Neither vendors or participants are ready when they started certification testing month learning curve to demonstrate compliance to baseline specifications and required message conformance/interoperability expectations.

16 DIL Statistics HIE participant learning curves vary widely. One example: Early failures -> Learning - > Refinement -> Success 16

17 DIL Statistics Once past the system configuration learning curve, DIL Test Execution is FAST: 12 MINUTES to actually execute the test cases required for Healtheway s 2013 onboarding program. 17

18 DIL Statistics Product Vendor learning curve example: Early failures -> Learning - > Refinement -> Success Vendors should take more time and make use of the DIL more extensively than individual participants. 18

19 DIL Statistics The DIL provides objective analysis of health information standards implementation and exchange problem areas: DIL execution data record the root cause(s) of conformance/interoperability failures: System/product failures Test case definition defect Specification lacks sufficient implementation guidance 19

20 DIL Architecture

21 Contact Us - HIMSS Booth 8545 AEGIS.net, Inc Research Boulevard, Suite 500 Rockville, MD Mario Hyland Senior Vice President mario.hyland@aegis.net (703) x707 (301) (c) DUNS: CAGE Code: 3YHD9 21