From information chaos to valuable knowledge production. Workshop: leadership Paula Saikkonen Sanna Blomgren, Pekka Karjalainen, Minna Kivipelto

Similar documents
CHECKLIST Quality Assessment for Final Evaluation Reports. Official(s) managing the evaluation:

Panamá. National Authority for Governmental Innovation. Terms of Reference

Making Access Possible (MAP) Nepal. Pre-bid briefing 21 May 2015

Quality Assessment for Evaluation Study of the forestry measures under Rural Development - Final Report

EXECUTIVE STRATEGIES FOR RISK MANAGEMENT BY STATE DEPARTMENTS OF TRANSPORTATION EXECUTIVE SUMMARY

Tools for Building Monitoring and Evaluation Systems in Public Works Projects

Guidance: Quality Criteria for Evaluation Reports

RIS3 Guide: Novelties of the approach. Dr Ruslan Rakhmatullin European Commission JRC IPTS - S3 Platform

Risk and Opportunity Management - Experiences and Lessons Learned a personal insight

Functional Area Assessment FAQ

Open Government Data Assessment Report Template

Module 6 Introduction to Measurement

HM082: Certified HR Assessor

An Analytical Tool For Assessing The Performance Of The Emergency Preparedness Machine

CONSULTANT OPPORTUNITY: Political economy researchers

BRICKENDON QUALITY MATURITY MODEL AND KEY PERFORMANCE INDICATORS BRICKENDON

Management Science Letters

Safety Culture Assessment for Design Organizations

TERMS OF REFERENCE. For a Bi-lingual Local Project Coordinator. To support stakeholder engagement and research on financial inclusion in Benin

QUALITY ASSESSMENT FORM 1

THE WORLD BANK GROUP. Program for Accountability in Nepal (PRAN)

Green Economy Learning Assessment

Impact Evaluation. Some Highlights from The Toolkit For The Evaluation of Financial Capability Programs in LMIC

ADVANCED MONITORING & EVALUATION: EVALUATION RESEARCH AND ANALYSIS. 3 day training course

Terms of Reference (TOR) National Consultant for Scoping Study on Fairer Labour Migration. 25 days during October-November 2015

Mid-term Project Evaluation Guidance Note For EIF TIER 1 Funded Projects: Support to National Implementation Arrangements

Return on Investment. E x e c u t i v e s u m m a r y

An E-Administration Strategy for Innovation Transfer

7.4. Analysis of capacity needs and gaps and possible strategies to address them

MAINSTREAMING GENDER IN ENERGY SECTOR PRACTICE AND POLICY

Areas of Specialization

Conservation NGOs project evaluations and monitoring workshop. September 8-9, 2010 Ulaanbaatar, Mongolia

The Effectiveness of Evaluation in the Social arena in Israel

A Common Gender Equality and Social Inclusion (GESI) Framework. GESI Working Group, IDPG 2017

Training on Project Cycle Management for Researchers Ethiopian Academy of Sciences May 2016, Ghion Hotel, Addis Ababa

Effective Section 75 Equality Assessments: Screening and Equality Assessments

Learning together during the QualityJourney External Feedback Procedure of City of Kuopio

Creating an Effective Social Performance Management System. Carmen Velasco PRO MUJER Bolivia March 2005

Paper no.25. Effectiveness of Strategic management: E-Government strategy implementation

ICT Agency of Sri Lanka

JVO EXECUTIVE EDUCATION PROGRAM 2016 TRAINING CALENDAR* COURSES

Policy recommendations for establishing country-led monitoring systems for water, sanitation and hygiene in Western and Central Africa

Setting the Stage: Workshop Framing and Crosscutting Issues

Monitoring and Evaluation. Elana Peach-Fine, May 6 th, 2018 Adapted from Elyssa Lewis, 2017

International Labour Organization (ILO) in cooperation with the Federation of Egyptian Industries (FEI)

PROMOTION STRATEGIES OF ELECTRONIC BANKING SERVICES IN KOSOVO

Envisioned Role of IT. Kuwait e-government Project Improving Government Administration & Services Through ICT

CI-GEF PROJECT AGENCY MONITORING AND EVALUATION POLICY FOR GEF-FUNDED PROJECTS

Integrated Outcomes Based Planning. Workshop presentation

Interim Evaluation of the Europe for Citizens Programme Final Report

New Zealand Aid Programme Results-Based Management Toolkit

Safe Community designation as quality assurance in local security planning

Western Balkans Recommendation on Public Participation

EPSA 2015 Final Event 17. November 2015 Head of Regional Development North Denmark Region Henning S. Christensen

AUDIT Where are we now? ONGOING MEASUREMENT Are we getting there?

THE IMPACTS OF OPEN DATA: TOWARDS EX POST ASSESSMENT

learning at work and wellbeing

SOCIAL SUSTAINABILITY: WHO BENEFITS AND WHO DOES NOT. December 5, 2010

Implementation of SDGs in Pakistan

Competency 3: Advance Human Rights and Social, Economic, and Environmental Justice

Embracing Quality in Local Public Health

EUROPEAN COMMISSION DG MOVE Mobility and Transport. Stakeholder Consultation Strategy. Improving Passenger Rail Security

DIAKONIA TERMS OF REFERENCE FOR BASELINE SURVEY CONSULTANCY PROCUREMENT REFERENCE NUMBER: DK/CONS/09/001/2015

JOB DESCRIPTION. Head of Business Analysis & Portfolio and Senior Business Analyst

COSCCOC02 (SQA Unit Code - HA3N 04) Prepare programmes and schedules of work in construction

REQUEST FOR PROPOSALS

DEVELOPING A MONITORING AND EVALUATION PROCESS FOR CAPACITY BUILDING AND EMPOWERMENT

The Difficulty of Indicating Transformation: The Challenge for Library Statistics and Surveys

VPUU and CeaseFire BASELINES

Report Summary: Success factors for the implementation of a Zero Accident Vision (ZAV)

STAKEHOLDER PARTICIPATION AT THE EU LEVEL AND IN SELECTED MEMBER STATES

Why is the counseling agency Oden successful? a joint evaluation and research project by social workers and researchers

The content is the responsibility of the producers of the information and does not necessarily represent the view of the Government.

of Influencing Consumer Behaviour

Organization Effectiveness Assessments Options and Outcomes

Political Economy Analysis Toolkit

RURAL GOVERNANCE AND INNOVATION

TOOL #47. EVALUATION CRITERIA AND QUESTIONS

Terms of Reference (ToR) End-of-the Project Evaluation UNDP Support to the Strategic Capacity Building Initiative

CONSULTANCY SERVICES FOR EVALUATION OF THE ECOWAS PROGRAMME ON GENDER MAINSTREAMING IN ENERGY ACCESS (ECOW-GEN) IN ECOWAS COUNTRIES

IRM s Professional Standards in Risk Management PART 1 Consultation: Functional Standards

Capturing Research Impacts: a review of international frameworks. Sonja Marjanovic IEA Meeting November 2010 Brussels

Gender Integration Workshop USAID/RDMA November Gender Equality and Female Empowerment: Agency Policies and Strategies

COUNTRY REPORT. Conduction of Online Survey in Estonia /O1/

Workshop II Project Management

Request for Proposal Urban Consultant to SymbioCity Project in Tunisia

Required enablers for successful Continuous Improvement initiatives across management levels

Logical Framework for the project

MULTICHANNEL MARKETING FOR PHARMA

SharePoint Version Number: [Version Number] SharePoint Reference Number: 62263

IPLAC CONFLICT ANALYSIS GUIDE

READILY APPLICABLE RESEARCH & EXPERIENCE

Guidance note B Evaluation guidelines

Gender mainstreaming strategy and action plan

Consultation in regulatory process. Tunis 31 May 2011 Pekka Nurmi

Health promotion for disadvantaged youth. Presentation

To be presented to the Joint Meeting of the Scientific Advisory Committee (SAC) / The Bureau of the IGC MOST, 26 March 2013 OUTLINE

Presented by: Maharufa Hossain. World Campus Training World Urban Forum III

Form: "Activities & Target Dates - Foundation" Created with: Taskstream Author: University at Buffalo Social Work Manager

6/25/2018. Year 2 Evaluation Planning June 25, Evaluation Progress

Transcription:

From information chaos to valuable knowledge production Workshop: leadership Paula Saikkonen Sanna Blomgren, Pekka Karjalainen, Minna Kivipelto

Outline Introduction Analytical framework Current situation: Findings, challenges Where to go? Possibilities Conclusion THL, Paula Saikkonen 2

Effectiveness evaluation in social work What kind of evaluation and assessment are needed to make betterments in social work? KEY (tool for evaluation) Knowledge production how to utilize produced information? In everyday work, in the local decision-making, in the management etc. THL, FinSoc-team 3

Analytical Framework I (KEY) Assumption of goal oriented social work Single-case design Has anything changed in the client s life? What are best methods of social work (quantitative data)? Realistic evaluation Goals, contextual and situational factors, social work methods What are the mechanism for change triggered by a social work and how do they counteract in the existing social processes? THL, FinSoc 4

KEY the tool collect relevant information Online questionnaire for determining the effectiveness of an intervention of social work with adults. Social worker and client set the goals together Seven main categories of goals Contextual factors, social work methods, basic information Testing phase: Evaluation I and Evaluation II THL 5

LOCAL DECISION-MAKING WELFARE SERVICES KNOWLEDGE PRACTICES Administration Single-case Organization evaluation Resource allocation Online -------------------------- questionnaire Social work procedures (KEY-measure) KNOWLEDGE PRODUCTION Information Evaluation Effectiveness evaluation ------------------ Research SOCIAL WORK METHODS

Research design and material KEY (testing phase in the several municipalities) Online questionnaire, planned together with social workers Client and social worker fill it together Quantitative data How to transform information into knowledge in the local decision making? Dynamics between the knowledge production and the decision-making What kind of information is a) utilized b) needed in the local decision-making? What kind of knowledge is used help with decisions? Qualitative data: combination of document material and interviews from three different Finnish municipalities (politicians, focal officers of the municipalities) THL, FinSoc-team 7

Findings Too tight budget constrains no knowledge about effectiveness of services Use of information Opportunities of ICT are missed Need of an institutional change Administrative silos, hierarchy Connection to national level; steering of the state More transparency in knowledge production is needed Conclusion; the concept of client should be broaden out THL, FinSoc-team 8

Possibilities for betterments? Clients (knowledge practices) Knowledge production Type of information Decision-makers (Database) a. Research, comparative studies b. Effectiveness evaluation (system) a. Ways to organize services b. Indicators (follow-up) Service producers, social workers (Real-time evaluation Database) Service users (Involvement in real-time evaluation, my data ) a. Process evaluation b. Effectiveness evaluation (social work) a. Process evaluation b. Effectiveness evaluation (empowerment) a. Are we doing right things? b. Knowledge about lacking services a. Access to needed services b. Impact of services Citizens, NGOs (open data, officials documents) a. Regional information b. Statements for local government Reports, initiative, Do politicians make right decisions? THL, FinSoc-team 9

What do we know? It is possible to measure effectiveness of social work. Local decision makers do not know social work too well. Income support is known much better Social work should be evaluated as a part of welfare system Evaluation should be a part of every day work (client databases) THL, FinSoc-team 10

Role of the leadership Constructing knowledge instead of gathering information Relevant data Clients participation and evaluation Possibility to get over silos Empowerment (clients as citizens) Towards cost efficiency? THL, FinSoc-team 11

Questions? paula.saikkonen@thl.fi Thank you! THL, FinSoc 12