Performance Measures Technical Assistance. Ready Children Impact Council Request for Proposals 7/18/2018

Transcription

1 Performance Measures Technical Assistance Ready Children Impact Council Request for Proposals 7/18/2018

2 What we will cover today Results Based Accountability (RBA) as Continuous Improvement Framework and how it is reflected in the Request for Proposals (RFP) Performance Measurement Implementation in the RFP in e- CImpact Question and Answer session

3 Results Based Accountability (RBA) Recap Results Indicators What works Strategies Programs Performance Measures

4 RBA Concepts Overview Population Definitions Performance Result A condition of well-being for children, adults, families or communities. Children Born Healthy Children Ready for School Safe Communities Clean Environment Prosperous Economy Program A program, organization, or service system Department of Public Health Foundation Non-Profit Grantee Early Education Program Indicator A measure which helps quantify the achievement of a result. R P Performance Measure A measure of how well a program, agency or service system is working. Rate of low-birth weight babies Percent ready at K entry Crime rate Air quality index Unemployment rate I PM Three Types 1. How much did we do? 2. How well did we do it? 3. Is anyone better off?

5 What this translates to in the RFP Results Indicators Strategies

6 Indicators and Egg Charts Example: Result 1 / Indicator 1 Number of confirmed victims of child abuse and neglect, ages 0 8, in Bexar County. 3,923 Number of completed investigations on alleged victims of child abuse and neglect, ages 0 8, in Bexar County. 15,969 Whole Population Number of children in Bexar County ages ,916

7 The RBA approach to Performance Measures (PM) (1)

8 The RBA approach to Performance Measures (PM) (2)

9 The approach to standardized metrics Comparability across applications for the same strategy Most programming operates along variations of the logic of Recruitment Enrollment Participation Completion Positive Impact Especially Better Off measures are worded intentionally open to fit a wide variety of different proposals Applicants are required to explain in the Proposal Narrative Section on Program Measurement & Evaluation how they plan to assess the performance on the Better Off metrics

10 RFP example of RBA conform measures Result 1, Strategy 1: Expand access to child and adult mental health, substance abuse, domestic violence and respite care services How much? # of new outreach efforts conducted to recruit children for services (in addition to current efforts) How well? # of families on average receiving information relevant to child services related to abuse prevention per outreach effort # of families receiving information relevant to child mental health, substance abuse, domestic violence and respite care services through outreach efforts # of children participating in mental health, substance abuse, domestic violence and/or respite care services regardless of wait time after referral # of children participating in mental health, substance abuse, domestic violence and/or respite care services within 60 days of referral # of children referred to service providers relevant to mental health, substance abuse, domestic violence and respite care services through conducted outreach efforts % of children participating in mental health, substance abuse, domestic violence and/or respite care services regardless of wait time after referral % of participating children receiving mental health, substance abuse, domestic violence and/or respite care services within 60 days of referral # / % of children completing participation in mental health, substance abuse, domestic violence and/or respite care services on schedule as per program model How better off? # / % of children at lower risk to experience child abuse as a result of receiving appropriate care # / % of children who are in a household not subject to a new CPS investigation within 12 months of program exit - no data entry required - metric will be pursued by United Way and is subject to further discussion in the impact council

11 Funnel view of program progression (1) Fewer Clients

12 Funnel view of program progression (2) Contribution to

13 What does this mean for PM calculations in e-cimpact? Most calculated metrics calculate against the number of participating clients as the denominator Guides applicants to consider how scale of a proposal is impacted by program progression Reminder: calculations will only appear after a Performance Measures Form has been saved The name of a calculated performance measure will indicate which count is being used as the denominator Example: % of participating (denominator) children 0-8 completing participation (numerator) in mental health, substance abuse, domestic violence and/or respite care services as per program model

14 Example e-cimpact PM Calculations

15 Target setting for Independent Applicants with multiple programs and Joint Applicants The targets set in the Performance Measures Form under each strategy must reflect the aggregate performance of all programs/partners included in the proposal The applicant is required discuss the individual contributions of programs and/or partners to the overall performance in its proposal narrative The applicant may disaggregate joint performance across multiple programs and/or partners by providing optional performance measures featuring performance targets of individual programs and/or partners

16 What if my strategy doesn t fit the standard format? By default the expectation is that all required predefined metrics are to be used wherever applicable within a proposal Applicants may propose additional measures on top of all required metrics If a required is not applicable due to the strategy not matching the proposed approach the applicant is required to describe why the metric is not applicable in the Performance Measurement & Evaluation section of the narrative When proposing additional metrics ensure that the right layer of the indicator in the egg chart is targeted

17 How to write PMs if optional metrics are chosen? (1) Write them against the target population indicated at the center of the egg chart Include the following when defining the name of a PM How are you measuring/counting - The type of measurement (number #, percent %, ratio, etc.) Who are you measuring - The unit of measurement (children, parents or caregivers, families) What are you measuring Description of what is being measured; avoid acronyms reviewers might not be familiar with where possible Type of measure How Much, How Well, Better Off following Results Based Accountability classification rules Number (how) of children (who) on target developmentally as assessed by the LAP-3 (what) (Better Off) (type)

18 How to write PMs if optional metrics are chosen? (2) When adding new metrics always provide an explanation of them in the Performance Measurement and Evaluation section of the Narrative Where providing a metric representing a percentage ensure to also provide the counts representing the numerator and denominator of the percentage calculation important to be able to assess the scale of impact Example: Percent of children on target developmentally as assessed by the LAP-3 (Better Off) Must be accompanied by Number of children on target developmentally as assessed by the LAP-3 (Better Off) - NUMERATOR And Number of children assessed by the LAP-3 (How Much) - DENOMINATOR

19 Where to add additional measures in e-cimpact

20 Resources e-cimpact Performance Measure Companion Guide - RFP FAQ - updated twice per week (Monday and Thursday) Please direct additional questions to rfp@unitedwaysatx.org responses will be provided through the RFP FAQ Clear Impact Results Based Accountability training guide Clear-Impact-PRESENTATION.pdf

21