Impact Measurement: Education, Income and Health

Transcription

1 Impact Measurement: Education, Income and Health GCL Advisory Council Marci Young and Peter Beard April 30, 2014

2 What is the Impact here? 2 Promoting Outcome Measurement Quality and Use

3 And here? 3 Promoting Outcome Measurement Quality and Use

4 Outcome: not how many worms the bird feeds its young, but how well the fledgling flies 4 Promoting Outcome Measurement Quality and Use

5 Key Issues in Measurement Measurement Quality Expectations Data Use Funding 5 Promoting Outcome Measurement Quality and Use

6 Information UWW Collects We survey United Ways for important information: Money Raised (UW1 to UW7) Money Raised for education, income and health Impact practices in education, income and health We also collect results from United Ways: Free tax preparation: Walmart Foundation and Bank of America Financial Capability: Wells Fargo Foundation 6

7 Develop and Implement Community Impact Strategies and Getting Results: The network advances its ability to develop and implement CI strategies. New survey in 2012 started a new baseline. 100% 80% 60% 40% 20% 0% 37% 30% 32% 25% Strategies 25% 29% 17% 19% 21% 12% 22% 17% Strategies + Results *Starting in 2012, strategies were measured on a scale showing four levels of performance. Only those at the top two levels showed strong performance and were counted above. Therefore, it s a higher strategy bar in vs and earlier. Note: The previous four years showed steady progress in strategies and results. = statistically significant difference Source: Community Impact Practices Survey 7

8 % of United Ways reporting any area under E, I, or H as one in which the most work was done in the past 12 months High-Level Areas In Which United Ways Most Worked in % 92% 89% 92% 80% 60% 40% 20% 0% Education Income Health 2013 CIPS Part 2, Margin of Error: +/- 1.7%, n=880 8 Source: United Way Research, 2013 Community Impact Practices Survey

9 % of United Ways reporting this as an area in which the most work has been done in the past 12 months Education: School Readiness is By Far the Most Common Area In Which United Ways Worked in % 80% 70% 60% 40% 20% 44% 28% 22% 16% 10% 0% School Readiness Early Grade Reading High School Graduation Middle School Success and Transitions Other College Completion and Career Readiness 2013 CIPS Part 2, Margin of Error: +/- 1.7%, n=880 9 Source: United Way Research, 2013 Community Impact Practices Survey

10 Early Grade Reading Approaches 10 Percentages are calculated from those who were filtered through to this question

11 % of United Ways reporting this as an area in which the most work has been done in the past 12 months Income: Income Supports Still the Most Prevalent Focus Area 100% 80% 60% 40% 20% 56% 46% 28% 28% 18% 0% Income supports Financial coaching and service integration, bundling* Affordable housing Family sustaining employment Other 11 Source: United Way Research, 2013 Community Impact Practices Survey

12 Roles United Way is Playing in Five Income Programs/Initiatives: Detail on Specific Roles Integrated service delivery Volunteer Income Tax Assistance sites Workforce funder collaborative Bank On Campaigns Affordable housing and/or homelessness prevention collaborations/coali tions Funder Program Operator Active Partner Currently in the planning process Count % by Row 27% 8% 26% 10% 27% Count % by Row 45% 31% 50% 4% 16% Count % by Row 15% 4% 19% 8% 37% Count % by Row 6% 5% 14% 9% 43% Count % by Row 42% 9% 55% 6% 15% None of the above 2013 CIPS Part 2 12

13 Key Issues in Measurement Measurement Quality Expectations Data Use Funding Promoting Outcome Measurement Quality and Use

14 A Dilemma about Results: What information to collect? Parenting Education Program 1. Parents from 10 families attend the workshops. 2. Six group workshops are conducted. 3. Parents' understanding of children's developmental issues increases. 4. Parents provide more age-appropriate guidance to children. 5. Parents participate in role plays and group discussions Program Outcome Measurement: Making the Investment Pay Off

15 A measure in Impact: Walmart Foundation In 2013: More than 1.7 million taxpayers filed their taxes at a site supported by the Walmart Foundation $2.1 billion in tax refunds were returned to MyFreeTaxes taxpayers, including $613.8 million in EITC 15 15

16 Another measure in Impact: Wells Fargo Report Metrics (annual) United Way of Central Iowa United Way of Forsyth County United Way of Greater Atlanta United Way of Greater Houston United Way of Miami- Dade United Way of Northeast Florida United Way of the Bay Area Valley of the Sun United Way 1. Increase the availability of customized financial education and one-on-one coaching. a. Total Unduplicated Clients That 5, ,429 3, ,003 1,457 21,630 Receive Financial Education b. Total Unduplicated Clients That Receive One-on-One Coaching , , ,312 c. Total Unduplicated Clients That Receive Additional Services 6, , ,484 10,523 d. Total Cumulative Unduplicated Clients Served Grant Period 11, ,720 3, ,376 2,471 33, Improve clients awareness of and access to financial services and appropriate savings and financial products. a. Increase in the number of low cost and appropriate products offered i. Number of clients who report using low-cost products b. Increase in use of alternative outreach platforms like text messaging and social media for hard-to-reach populations i. Number of clients subscribing to platforms 4, Facebook Likes 5, Increase the number of low to moderate income working families that are more financially capable as demonstrated by: a. Total Unduplicated Clients That , ,695 Achieve At Least One Of Outcomes 3d-3h 1 b. Total Unduplicated Clients That ,077 Achieve Exactly Two of Outcomes 3d- 3h c. Total Unduplicated Clients That Achieve Three or More of Outcomes 3d-3h d. Number of individuals That increase their credit scores e. Number of people that open and maintain bank accounts ,727 i. Number of New Clients that Are Already Banked and have Bank Accounts Total 1 3. Increase the number of low to moderate income working families that are more financially capable as demonstrated by: d. Number of individuals who increase their credit scores e. Number of people who open and maintain bank accounts i. Number of New Clients Who Are Already Banked and have Bank Accounts ii. Number of Clients Who Are Unbanked and Have No Bank Account iii. Number of Clients Who Open New Bank Accounts iv. Number of Previously Unbanked Clients Who Maintain Current Bank Accounts f. Percentage increase in bills paid on time and/or percentage decrease in collections g. Number of individuals that have developed a budget and/or long-term financial plan h. Number of individuals that decrease their use of alternative financial services i. How many have reported using them ii. How many have reported decreasing their use 16 16

17 Not everything that can be counted counts and not everything that counts can be counted. - Albert Einstein Promoting Outcome Measurement Quality and Use

18 18 Discussion and Questions