Implementing Evidence to Achieve Child Welfare Outcomes

Transcription

1 Implementing Evidence to Achieve Child Welfare Outcomes New Jersey Task Force on Child Abuse and Neglect 2017 Biennial Conference Allison Metz, Ph.D. Director and Senior Scientist September 8, 2017

2 Implementation Science Effective Practices Effective Implementation Enabling Context Improved Outcomes Intervention Selection Implementation Defined. (n.d.). Retrieved November 22, 2016, from

3 Intervention Selection Need in community, region, state Socially significant Issues Parent & community perceptions of need Data indicating need Need - Data demonstrating the needs of the population and the EBP/EIP Fit - Alignment of EBP/EIP approach with local and state priorities and initiatives Resources - Resources & supports available for developing organizational and systems readiness, engaging key stakeholders in the system, and decisionsupport data systems Capacity to Implement Staff meet minimum qualifications Able to sustain Imp Drivers Financially Structurally Buy-in process operationalized Practitioners Families CAPACITY NEED FIT Fit with current Initiatives Community, regional, state priorities Organizational structures Community values Evidence- Expected outcomes when EBP/EIP is implemented as intended Usability- Extent to which EBP/EIP approach is welldefined Capacity - Required staffing and administrative practices, and capacity for data input and analysis, and fidelity and outcome assessments Usability for Replication Qualified purveyor Expert or TA available Mature sites to observe Several replications How well is it operationalized? Are Imp Drivers operationalized? USABILITY EVIDENCE Evidence Outcomes Is it worth it? Fidelity data Cost effectiveness data Number of studies Population similarities Diverse cultural groups Efficacy or Effectiveness RESOURCES Resources and supports for: Interventions Technology supports (IT dept.) Staffing Training Data Systems Coaching & Supervision Administration & system

4 IS for Improved Outcomes Effective Practices Effective Implementation Enabling Context Improved Outcomes Drivers Implementation Defined. (n.d.). Retrieved November 22, 2016, from

5 What does Prena need to support her practice?

6 Competency Supports Organizational Supports Leadership Supports Fidelity Assessment Coaching Process Training Process Selection Process ] Systems Intervention Facilitative Administration Decision Support Data Systems

7 Implementation Drivers Positive Child and Family Outcomes Consistent Use of EBP/EIP Fidelity Coaching Systems Intervention Selection Training Integrated & Compensatory Integrated & Compensatory Facilitative Administration Decision Support Data System Leadership Drivers Technical Adaptive

8 IS for Improved Outcomes Effective Practices Effective Implementation Enabling Context Improved Outcomes Teams Data & Communication Implementation Defined. (n.d.). Retrieved November 22, 2016, from

9 Teams and Stakeholder Engagement Working in complex systems requires the engagement and influence of multiple stakeholders. This requires a different kind of leadership- moving from solo heroes to collaboration and teamwork. 11 Collaboration leads to: Practices that are more implementable Infrastructure that brings practice and implementation closer together Attention to local needs and increased relevance and impact of implementation activity Enhanced capacity and capability of implementation (Rycroft Malone and colleagues, 2013

10 Team Functions Core Practice Operationalize core practices of the EBP/EIP Infrastructure Develop guiding processes for building staff competency and organizational capacity to support the implementation of EBP/EIP Improvement Cycles Identify metrics to assess and improve implementation of practices; develop communication protocols Systems Build cross-sector collaboration and buy-in for the EBP/EIP model and garner support and buy-in from key stakeholders, including families

11 Using Data for Improvement Continuous Quality Improvement involve developing a process for identifying, collecting, and analyzing data that are useful to make decisions on improvement. This process should be ongoing. The process should provide timely, reliable data for decision-making. CQI Best Practices: Clear accountability for CQI Support for those accountable for CQI CQI activities built into regular practice routines CQI used to support data-driven decision-making for the purpose of improvement

12 Communication & Learning Program Management Team Practice Informs Policy Sustainability Policy Enables Practice Implementation Team Direct Service Staff

13 Allison Metz Frank Porter Graham Child Development Institute University of North Carolina Chapel Hill, NC

14 Citation and Copyright This document is based on the work of the National Implementation Research Network (NIRN) Allison Metz & Leah Bartley This content is licensed under Creative Commons license CC BY-NC-ND, Attribution-NonCommercial-NoDerivs. You are free to share, copy, distribute and transmit the work under the following conditions: Attribution You must attribute the work in the manner specified by the author or licensor (but not in any way that suggests that they endorse you or your use of the work); Noncommercial You may not use this work for commercial purposes; No Derivative Works You may not alter, transform, or build upon this work. Any of the above conditions can be waived if you get permission from the copyright holder. web: The mission of the National Implementation Research Network (NIRN) is to contribute to the best practices and science of implementation, organization change, and system reinvention to improve outcomes across the spectrum of human services.