Results-Based Accountability. Benchmarks for a Better Vermont

Transcription

1 Results-Based Accountability Benchmarks for a Better Vermont

2 WHY BOTHER? Get clear about barriers and leverage points. Target our resources. Invite key partners. Develop a campaign of linked strategies. Make mid-course corrections. Galvanize support. Stop to celebrate. Foster pride. 2

3 RESULTS-BASED ACCOUNTABILITY Framework for planning Process for moving from talk to action Cycle for continuous improvement Tool for communicating

4 RBA METHODOLOGY Uses Clear Language

5 LANGUAGE TRAP Too many terms. Too few definitions. Too little discipline. Outcome Benchmark Result Indicator Measure Modifiers Measurable Core Urgent Qualitative Priority Programmatic Targeted Performance Incremental Strategic Systemic Goal Objective Target

6 DEFINITIONS population Result or Outcome A condition of well-being for children, adults, families or communities Indicator or Benchmark A measure which helps quantify the achievement of a result

7 DEFINITIONS performance accountability Performance Measure A measure of how well a program, agency or service system is working (client or customer results) Strategy Our best thinking about what works, actions which have a reasoned chance of improving conditions.

8 RBA METHODOLOGY Uses Clear Language From Ends to Means

9 ENDS TO MEANS Population Accountability Result Indicator ends Performance Accountability Performance Measure Strategy Customer result = Ends Service delivery = Means means

10 RBA METHODOLOGY Uses Clear Language From Ends to Means Two Levels of Accountability

11 LEVELS OF ACCOUNTABILITY 1. Population Level Accountability Communities, cities, states nations. Collective accountability: Many partners are responsible for achieving the desired result. 2. Performance Level Accountability Programs, agencies, service systems. Program accountability: Program is responsible for its performance.

12 RESULTS for ALL People of the State, County, City or Neighborhood Children in St Johnsbury are Ready for School Rutland County Adults Lead Healthy and Productive Lives All Vermonters Enjoy Psychological Well-Being Vermonters Are Safe Vermont s Creative Sector Thrives

13 EXAMPLE INDICATORS: RESULT: Vermont s Creative Sector Thrives Indicators % of contribution to state economy Vermonter s average distance from cultural institution

14 Flickr Creative Commons William Warby : wwarby QUIZ!

15 QUIZ ANSWERS Result, Indicator, or Performance Measure? 1. Safe Community 2. Crime Rate 3. Average Police Dept response time 4. An educated workforce 5. Adult literacy rate 6. # & % of clients at 8 th grade reading levels 7. People are financially stable 8. % of people with livable wage jobs 9. # and % of participants in job training program who get livable wage job 1. Result 2. Indicator 3. PM 4. Result 5. Indicator 6. PM 7. Result 8. Indicator 9. PM

16 RBA METHODOLOGY Uses Clear Language From Ends to Means Two Levels of Accountability Turn the Curve Thinking

17 Turn the Curve Thinking 1. What do we want for our community? 2. How will we recognize it? 3. How can we measure these conditions? RESULT: Clean and Healthy Environment 4. How are we doing now? 5. Who are the partners? 6. What works to do better? INDICATORS: % of days with clean air % of stream miles meeting water quality standards % of solid waste going to landfills 7. What do we propose to do?

18 RBA METHODOLOGY Uses Clear Language From Ends to Means Two Levels of Accountability Turn the Curve Thinking Three kinds of Performance Measures

19

20 PROGRAM PERFORMANCE MEASURES Quantity Quality Output Effect Input Effort How Much Did We Do? Is Anyone Better Off? How much change/ effect did we produce # % How Well Did We Do It? Is Anyone Better Off? What quality of change/ effect did we produce

21 EXAMPLE: Fire Department Quantity How Much? Quality How Well? Effect Effort Number of responses Is Anyone Better Off? # of fires kept to room of origin Response Time % of fires kept to room of origin

22 EXAMPLE: Board Service Effect Effort Quantity How Much? Number of board members. Number of board meetings Is Anyone Better Off? Number of board members who made an annual gift. Quality How Well? Average number of board members in attendance at meetings Percent of board members who made an annual gift.

23 EXAMPLE: High School Arts Program Effect Effort Quantity How Much? Number of students who participate. Is Anyone Better Off? Number of students who report broadened cultural perspectives Quality How Well? Percent of students who participate in 3 consecutive sessions Percent of students who report broadened cultural perspectives

24 PROGRAM PERFORMANCE MEASURES Quantity How Much? Quality How Well? Effect Effort # People Served # Hours of Service # Activities (by type of activity) Is Anyone Better Off? - Participant satisfaction - Use of Best Practice - Staff qualifications/training - External Review Change in skills, knowledge, attitude, behavior, circumstance, well being Possible sources: Program records, participant survey, external data

25 QUESTIONS

26 CONTACT INFO Hillary Orsini (802)

27 EXTRA SLIDES

28 GROUP WORK Performance Grid Activity

29 PICKING HEADLINE PERFORMANCE MEASURES Flickr Creative Commons Phil Whitehouse

30 BREAK.

31 RBA METHODOLOGY Uses Clear Language From Ends to Means Two Levels of Accountability Three kinds of Performance Measures Turn the Curve Thinking

32 GROUP WORK Turn the Curve at the Performance Level

33 RBA METHODOLOGY Uses Clear Language From Ends to Means Two Levels of Accountability Three kinds of Performance Measures Turn the Curve Thinking

34 RBA IN VERMONT The Outcomes Bill Act 186 Signed into law June To include population and performance accountability of state government.

35 RBA IN VERMONT The Outcomes Bill Act 186 Legislature sets OUTCOMES and INDICATORS State departments and programs contribute to outcomes and indicators through their programs. Grantees of the state also make contributions Departments and grantees measure their own program performance using performance measures.

36 QUESTIONS

37

38 Turn The Curve Conversation 5 min: Starting Points Timekeeper and reporter Two hats (yours plus a partner s) 5 min: 15 min: 5 min: 20 min: 10 min: Baseline Pick a curve to turn Draw it Forecast is it ok or not ok? Story behind the baseline Causes/forces at work Information/Research agenda Ask 5 whys? Partners What works? (What would it take) What works/what doesn t Each partner s contribution No cost/ Low cost/off the wall ideas Information/ Research agenda Report 1 page 4 best ideas (including one no/low cost) Off the wall funniest idea Result: Pleasantville s youth choose healthy behaviors and become successful adults Data Baseline: Story Behind the Baseline: Partners: REPORT Four Best Ideas what works [sharp edges] include low cost/no cost and off the wall

39 RBA IN VERMONT GOALS Develop performance measures Set realistic goals Monitor progress using data Make needed changes Show contribution Report on a regular basis Use online dashboards for indicators and performance measures Increase transparency and understanding of what is working to make change on major issues