The Public Impact Fundamentals Self-assessment tool
Contents Introduction & methodology...03 Self-assessment tool...05 Conduct an assessment...06 Identify areas for action...16 Design an action plan...18 The Public Impact Fundamentals Self-assessment tool 2
Introduction & methodology The Public Impact Fundamentals Self-assessment tool 3
The Public Impact Fundamentals What are the Public Impact Fundamentals: The Public Impact Fundamentals are a framework for thinking about the elements that most influence the impact of government initiatives. There are three Fundamentals: Legitimacy: Underlying support for an objective and the attempts to achieve it Policy: Quality of policies intended to achieve impact Action: Translation of policies into real-world effect which collectively contribute to its performance: The framework LEGITIMACY Public confidence Stakeholder engagement Political commitment POLICY Clear objectives Evidence Feasibility ACTION Management Measurement Alignment The Public Impact Fundamentals Self-assessment tool 4
Self-assessment tool Background Self-assessment is based on three core parts of the Centre for Public Impact (CPI) proprietary research: Fundamentals of Public Impact - a framework for thinking about the elements that most influence the impact of government initiatives Fundamentals rubric - the standard way used by CPI researchers to assess policy case studies on the nine elements of the Fundamentals Observatory of case studies - a collection of 250+ case studies assessed using the Fundamentals rubric From these, we are able to assess how impactful an initiative will be, based on how well it ranks against the Fundamentals. Objectives The objective of this qualitative assessment is to evaluate whether the key elements that typically lead to impactful policies are in place in the chosen initiative and guide the reader to improve its weaknesses and maintain its strengths. How does it work Pick one initiative that is currently being consideed for implementation or is one that is under implementation / has been implemented. Over the next few pages, we will guide you through the assessment in three steps, as illustrated below. They will help you to identify key strengths and weaknesses, as well as target interventions to improve performance along a subset of the elements, maximising the chances of the initiative achieving public impact. Conduct an assessment 1 Identify areas for action 2 Design an action plan 4 3 The Public Impact Fundamentals Self-assessment tool 5
Conduct an assessment 1 Legitimacy - Support for an objective and attempts to achieve it Using the support information, please draw a circle around the option that best describes how the initiative performs on this specific element ELEMENT Public confidence Support information Definition The extent to which the general public trusts the institutions involved to act competently and in support of the wider public interest in the execution of this objective Supporting questions Is there public confidence in: Overall outcome pursued? Institutions responsible for delivering outcome? Specific initiatives carried out to acheived outcome?? Possible sources Elections Opinion polls Surveys Your assessment WEAK FAIR GOOD STRONG Significant public distrust in the institutions involved Public neither strongly trust nor distrust institutions involved Public broadly trust the institutions involved Strong public trust in the institutions involved Reasoning (optional) The Public Impact Fundamentals Self-assessment tool 6
Conduct an assessment 1 Legitimacy - Support for an objective and attempts to achieve it Using the support information, please draw a circle around the option that best describes how the initiative performs on this specific element ELEMENT Stakeholder engagement Support information Definition The degree to which relevant stakeholder groups are supportive of the objective and the approach Supporting questions? Is there evidence of internal and external stakeholder support? Are interests of the internal and external stakeholders aligned to support the policy? Is there evidence of stakeholder engagement in the policy-design process? Possible sources Elections Opinion polls Surveys Your assessment WEAK FAIR GOOD STRONG Majority of stakeholders are opposed Tentative support from some stakeholders Solid support from majority of stakeholders Strong support from key stakeholders Reasoning (optional) The Public Impact Fundamentals Self-assessment tool 7
Conduct an assessment 1 Legitimacy - Underlying support for objective and attempts to achieve it Using the information below, please draw a circle around the option that best describes how the initiative performs on this specific element ELEMENT Political commitment Support information Definition Supporting questions? Possible sources Willingness of politicians and other leaders to spend political capital in support of this objective Is this a political priority for the political leadership? Where is active opposition coming from? Speeches from politicians Party manifestos Opinion from political actors in newspapers Your assessment WEAK FAIR GOOD STRONG Important political actors are actively opposed Tentative support from some political actors Solid support from majority of political actors Strong support across the political spectrum Reasoning (optional) The Public Impact Fundamentals Self-assessment tool 8
Conduct an assessment 1 Policy - Quality of policies intended to achieve impact Using the information below,, please draw a circle around the option that best describes how the initiative performs on this specific element ELEMENT Clear objectives Support information Definition The extent to which the public impact objectives have been stated at the outset and maintained throughout the period being considered Supporting questions? Does the policy state specific and measurable outcome objectives? Do the outcome objectives address the relevant issues? Were the objectives maintained over time? Possible sources Organisation publications Initiative blueprint Initiative implementation plan Articles/case studies/reports on initiative Your assessment WEAK FAIR GOOD STRONG No objectives stated Objectives stated at outset but weakened over time Objectives stated at outset and clarified over time Objectives defined at the outset and maintained throughout Reasoning (optional) The Public Impact Fundamentals Self-assessment tool 9
Conduct an assessment 1 Policy - Quality of policies intended to achieve impact Using the information below, please draw a circle around the option that best describes how the initiative performs on this specific element ELEMENT Evidence Support information Definition The extent to which the best available evidence was brought to bear in determining the policy direction Supporting questions? Do policy-makers draw on evidence of existing similar policies? Does evidence support impact of former similar initiatives? Is this evidence based on reliable sources? Are pilots being rolled out? Are pilot results used to adapt the policy? Possible sources Organisation publications Initiative blueprint Feasibility studies Initiative implementation plan Articles/case studies/reports on initiative Your assessment WEAK FAIR GOOD STRONG No evidence or clear evidence to the contrary Mixed evidence for approach Broadly positive evidence in favour of approach Strong evidence in favour of approach (e.g., multiple studies, pilots) Reasoning (optional) The Public Impact Fundamentals Self-assessment tool 10
Conduct an assessment 1 Policy - Quality of policies intended to achieve impact Using the information below, please draw a circle around the option that best describes how the initiative performs on this specific element ELEMENT Feasibility Support information Definition Supporting questions? Possible sources The extent to which the proposed approach is feasible in terms of resources (e.g. financial, people) and time (e.g. unrealistic deadlines) Were legal concerns evaluated exhaustively? Were fiscal constraints evaluated exhaustively? Were human resources constraints evaluated exhaustively? Was any large feasibility challenge identified? Organisation publications Initiative blueprint Initiative implementation plan Articles/case studies/reports on initiative Your assessment WEAK FAIR GOOD STRONG Significant doubts over feasibility of initiative/major challenges likely Some doubts over feasibility of initiative/some challenges likely Initiative considered to be feasible with a few manageable challenges Initiative considered to be highly feasible with no real challenges Reasoning (optional) The Public Impact Fundamentals Self-assessment tool 11
Conduct an assessment 1 Action - Translation of policies into real-world effect Using the information below, please draw a circle around the option that best describes how the initiative performs on this specific element ELEMENT Management Support information Definition The extent to which mechanisms are in place to ensure progress is made Supporting questions Are there skilled programme managers who understand the context and are continuously aligned on goals and approach? Is there use of data to drive intelligent decision-making? Is there pragmatic resolution of issues?? Possible sources Organisation publications Initiative implementation plan and methodology Articles/case studies/reports on initiative Your assessment WEAK FAIR GOOD STRONG No obvious mechanisms in place to ensure progress is made Some mechanisms in place to ensure progress is made but with significant weaknesses Good mechanisms in place to ensure progress is made with only minor weaknessess Strong mechanisms in place to ensure progress is made Reasoning (optional) The Public Impact Fundamentals Self-assessment tool 12
Conduct an assessment 1 Action - Translation of policies into real-world effect Using the information below, please draw a circle around the option that best describes how the initiative performs on this specific element ELEMENT Measurement Support information Definition The extent to which attempts have been made to ensure public impact can be measured and used to inform the approach over time Supporting questions Are effective measurement functions incorporated in the execution of the policy? Is the impact of the policy monitored consistently? Do the indicators capture the outcome objectives of the policy? Are the results of the outcome measurements used to adapt the policy where necessary?? Possible sources Organisation publications Initiative implementation plan and methodology Articles/case studies/reports on initiative Your assessment WEAK FAIR GOOD STRONG No metrics identified Metrics identified at outset but not tracked over time and/or incomplete Comprehensive metrics identified at outset and tracked over time but not used to significantly influence approach Comprehensive metrics identified at outset and tracked over time with results used to assess progress and refine approach Reasoning (optional) The Public Impact Fundamentals Self-assessment tool 13
Conduct an assessment 1 Action - Translation of policies into real-world effect Using the information below, please draw a circle around the option that best describes how the initiative performs on this specific element ELEMENT Alignment Support information Definition The extent to which those actors required to make change happen (e.g. frontline workers, service users, general public) share an alignment of interests in relation to the achievement of this objective Supporting questions Are there different interests among implementing actors? Are the relevant actors cooperating effectively? Are all actors equipped to execute their part of initiative? Are the main actors motived to execute the initiative?? Possible sources Organisation publications Initiative implementation plan and methodology Articles/case studies/reports on initiative Your assessment WEAK FAIR GOOD STRONG No alignment of interests between the actors required to make change happen Partial alignment of interests between the actors required to make change happen Good alignment of interests between the actors required to make change happen Strong alignment of interests between the actors required to make change happen Reasoning (optional) The Public Impact Fundamentals Self-assessment tool 14
Conduct an assessment 1 Summary of results Please fill in with the results of your assessment Initiative name: Assessment (Weak-Strong) Grade (see key below) Average score for Fundamental Legitimacy Public confidence Stakeholder engagement Political commitment Clear objectives Policy Evidence Feasibility Management Action Measurement Alignment Grade key: Strong = 3 Good = 2 Fair = 1 Weak = 0 The Public Impact Fundamentals Self-assessment tool 15
Identify areas for action 2 Identifying areas for action To identify areas for action, follow the instructions below. Please refer to your scores from the Summary of results page (page 15) I. II. III. Identifying the strengths of the initiative List the three highest scoring elements below I. II. III. Identifying the weaknesses of the initiative List the three lowest scoring elements below The Public Impact Fundamentals Self-assessment tool 16
Identify areas for action 2 Specific challenges and strengths in selected areas Out of the six elements selected on the previous page, select three that you/your department can influence the most and write them down in the boxes on the left hand side. Explain the reasons for choosing those elements Selected elements Reasons for selection 1 2 What are the key strengths of the initiative and what could be done to re-inforce these? 3 The Public Impact Fundamentals Self-assessment tool 17
Design an action plan 3 Design an action plan Thinking about the three elements you have selected that you / your department can influence the most, write down actions that can be taken to improve weaknesses or maintain strengths Selected elements Actions that can be taken 1 2 What are the key strengths of the initiative and what could be done to re-inforce these? 3 The Public Impact Fundamentals Self-assessment tool 18
The Public Impact Fundamentals Self-assessment tool 19
I. Using the resources below, you can learn more about the theory behind the Fundamentals, as well as see policy initiatives from around the world graded using the Fundamentals rubric to assess public impact Read the Public Impact Fundamentals report to gain a deeper understanding of a framework underpinned by cutting-edge thinking from academia and tested by government officials. Available in English, Spanish and Portuguese Go to the Public Impact Observatory and filter case studies by policy areas, region and rating along the nine elements Explore our range of articles and insights from conversations, with policymakers across the globe II. Connect with us for more tailored engagements. We offer: Public Impact Fundamentals seminars and workshops Short assessments and policy evaluation To find out more, please email us on: info@centreforpublicimpact.org Thank you! The Public Impact Fundamentals Self-assessment tool 20