Results Based Accountability Future Directions Workshop. Leoma Tawaroa Raniera Tawaroa

Transcription

1 Results Based Accountability Future Directions Workshop Leoma Tawaroa Raniera Tawaroa 1

2 Results Accountability The Fiscal Policy Studies Institute Santa Fe, New Mexico Websites raguide.org resultsaccountability.com Book - DVD Orders sheapita.co.nz amazon.com resultsleadership.org 2

3 Results Accountability is made up of two parts: Population Accountability about the well-being of WHOLE POPULATIONS For Communities Cities Counties Iwi Performance Accountability about the well-being of CLIENT POPULATIONS For Programs Agencies and Service Systems 3

4 Results Accountability is made up of two parts: Population Accountability about the well-being of WHOLE POPULATIONS All Adults in NZ are healthy All Families in Invercargill are economically secure All Rangatahi in Mataura are culturally secure For Communities Cities Counties Iwi Performance Accountability about the well-being of CLIENT POPULATIONS All 2 year old children enrolled in the practice are fully immunised All adults in our budgeting programme are financially literate All Rangatahi in our service know their Whakapapa For Programs Agencies and Service Systems 4

5 DEFINITIONS Population Performance RESULT or OUTCOME A condition of well-being for children, adults, families or communities. Children born healthy, Children ready for school, Safe communities, Clean Environment, Prosperous Economy INDICATOR or BENCHMARK A measure which helps quantify the achievement of a result. Rate of low-birthweight babies, Percent literacy milestones met, crime rate, air quality index, unemployment rate PERFORMANCE MEASURE A measure of how well a program, agency or service system is working. Three types: 1. How much did we do? 2. How well did we do it? 3. Is anyone better off? = Customer Results 5

6 From Ends to Means From Talk to Action Population RESULT or OUTCOME INDICATOR or BENCHMARK ENDS Performance PERFORMANCE MEASURE Customer result = Ends Service delivery = Means MEANS 6

7 RESULT INDICATOR PERF. MEASURE RESULT INDICATOR RESULT INDICATOR PERF. MEASURE IS IT A RESULT, INDICATOR OR PERFORMANCE MEASURE? 1. A Safe Community 2. Crime Rate 3. Average Police Dept response time 4. An Educated Workforce 5. Adult literacy rate 6. People have living wage jobs and income 7. % of people with living wage jobs and income 8. % of participants in job training who get living wage jobs 7

8 POPULATION ACCOUNTABILITY For Whole Populations in a Geographic Area Fiscal Policy Studies Institute Santa Fe, New Mexico 8

9 Tip for drafting population accountability outcomes All in are Families Invercargill Economically Secure Insert your Population Insert your Geographic area Insert your Condition of Wellbeing 9

10 1. A Safe City Community Outcomes for Christchurch, NZ 2. A City of Inclusive and Diverse Communities 3. A City of People who Value and Protect the Natural Environment 4. A Well-Governed City 5. A Prosperous City 6. A Healthy City 7. A City for Recreation, Fun and Creativity 8. City of Lifelong Learning 9. An Attractive and Well-Designed City 10

11 11

12 Te Piringa Maori Health Promotion Mauri Ora All Maori in Murihiku are Culturally Secure Waiora All Maori in Murihiku are Protectors of the Environment Toiora All Maori in Murihiku are Safe & Healthy Whaiora All Maori in Murihiku Participate in Society Nga Manukura All Maori in Murihiku are Community leaders Mana Whakahaere All Maori Communities are Autonomous Population Outcomes 12

13 Summary 2 key types of accountability: Population Performance 3 types of performance measures: How Much How Well Better Off From Ends to Means: Change our thinking and approach: from what we do to what we achieve 13

14 Performance Accountability For Programs, Agencies and Service Systems Fiscal Policy Studies Institute Santa Fe, New Mexico

15 Leaking Roof (Results thinking in everyday life) Experience: Measure: Inches of Water Not OK? Fixed Turning the Curve Story behind the baseline (causes): Partners: What Works: Action Plan: 15

16 LR UR 16

17 Turn the Curve: Reduce the local suicide rate. 17

18 Turn the Curve Exercise: Performance Accountability 5 min: Starting Points - timekeeper and reporter - identify a program to work on - two hats (yours plus partner s) 5 min: Performance measure baseline - choose 1 measure to work on from the lower right quadrant - forecast OK or not OK? 15 min: Story behind the baseline - causes/forces at work - information & research agenda part 1 - causes 15 min: What works? (What would it take?) - what could work to do better? - each partners contribution - no-cost / low-cost ideas - information & research agenda part 2 what works 10 min: Report Convert notes to one page Two pointers to action 18

19 Off the Wall ONE PAGE Turn the Curve Report: Performance Program: Performance Measure Baseline Performance Measure (Lay definition) Story behind the baseline (List as many as needed) Partners (List as many as needed) Three Best Ideas What Works No-cost / low-cost Off the Wall Sharp Edges 19

20 Summary 2 key types of accountability: Population Performance 3 types of performance measures: How Much How Well Better Off 7 questions From Ends to Means: Change our thinking and approach: from what we do to what we achieve 20

21 Results Accountability is made up of two parts: Population Accountability about the well-being of WHOLE POPULATIONS For Communities Cities Counties States - Nations Performance Accountability about the well-being of CLIENT POPULATIONS For Programs Agencies and Service Systems 21

22 All performance measures that have ever existed for any program in the history of the universe involve answering two sets of interlocking questions. 22

23 Performance Measures Quantity Quality How Much did we do? ( # ) How Well did we do it? ( % ) 23

24 Performance Measures Effort How hard did we try? Effect Is anyone better off? 24

25 Performance Measures Quantity Quality Effect Effort Output Input How much service did we deliver? How much change / effect did we produce? How well did we deliver it? What quality of change / effect did we produce? 25

26 Drug/Alcohol Treatment Program Quantity How much did we do? Quality How well did we do it? Effect Effort Number of persons treated Number of clients off alcohol & drugs - at exit - 12 months after exit Is anyone better off? Percent of staff with training/ certification Percent of clients off alcohol & drugs - at exit - 12 months after exit 26

27 Pediatric Practice Quantity How much did we do? Quality How well did we do it? Effect Effort Number of patients treated # children fully immunized (in the practice) Is anyone better off? Percent of patients treated in less than 1 hour % children fully immunized (in the practice) 27

28 Separating the Wheat from the Chaff Types of Measures Found in Each Quadrant How much did we do? # Clients/customers served # Activities (by type of activity) # # # # Point in Time vs. Point to Point Improvement Is anyone better off? How well did we do it? % Common measures e.g. client staff ratio, workload ratio, staff turnover rate, staff morale, % staff fully trained, % clients seen in their own language, worker safety, unit cost % Activity-specific measures e.g. % timely, % clients completing activity, % correct and complete, % meeting standard % Skills / Knowledge (e.g. parenting skills) % Attitude / Opinion (e.g. toward drugs) % Behavior (e.g.school attendance) % Circumstance (e.g. working, in stable housing) 28

29 Group Exercise 2 1. Develop a Performance Measure Framework programme or service (the 4 Quadrants) How much, how well, better off? 29

30 Separating the Wheat from the Chaff Types of Measures Found in Each Quadrant How much did we do? # Clients/customers served # Activities (by type of activity) # # # # Point in Time vs. Point to Point Improvement Is anyone better off? How well did we do it? % Common measures e.g. client staff ratio, workload ratio, staff turnover rate, staff morale, % staff fully trained, % clients seen in their own language, worker safety, unit cost % Activity-specific measures e.g. % timely, % clients completing activity, % correct and complete, % meeting standard % Skills / Knowledge (e.g. parenting skills) % Attitude / Opinion (e.g. toward drugs) % Behavior (e.g.school attendance) % Circumstance (e.g. working, in stable housing) 30

31 How Population & Performance Accountability FIT TOGETHER 31

32 THE LINKAGE Between POPULATION and PERFORMANCE POPULATION ACCOUNTABILITY Healthy Births Rate of low birth-weight babies Children Ready for School Percent fully ready per milestone assessment Self-sufficient Families Percent of parents earning a living wage PERFORMANCE ACCOUNTABILITY Job Training Program POPULATION RESULTS Contribution relationship Alignment of measures # persons receiving training # who get living wage jobs Unit cost per person trained % who get living wage jobs CUSTOMER RESULTS Appropriate responsibility 32

33 KIA ORA/THANK YOU! WEBSITES: BOOK ORDERS: