Baseline Survey and Impact Assessment. Vidya Naik

Size: px

Start display at page:

Download "Baseline Survey and Impact Assessment. Vidya Naik"

Gervais Barker
6 years ago
Views:

1 Baseline Survey and Impact Assessment Vidya Naik

2 Small Exercise What will you gain from this workshop? How will you know that this workshop is effective? What will you compare learning from this workshop with? What is the best comparison with? What are your CSR activities? 2/17/2012 2

3 Sequence Baseline Survey Intervention Impact Assessment 2/17/2012 3

4 Generally Baseline survey is followed by intervention and then the Impact assessment. Ideally during intervention, monitoring phase should track changes happening, to ensure success at the end of the project. 2/17/2012 4

5 Base Line & Impact Study Before and After study (Pre & Post) Before the intervention (Baseline) After the intervention (Impact) 2/17/2012 5

6 Baseline Survey and Assessing Needs Impact Assessment Planning Implementation and Monitoring 2/17/2012 6

7 Baseline Study - What? Baseline study provides an information base (prior to the intervention) against which one can monitor activity s progress during the intervention and assess effectiveness after the intervention. 2/17/2012 7

8 Areas of Intervention Agriculture, Horticulture Water Management ( Community Well) Dairy Education, Skills development Health Any other????? 2/17/2012 8

9 Who need it? Govt for feasibility / efficacy of development projects Donors for funding projects Organizations for worthwhileness of projects 2/17/2012 9

10 Baseline Study - Why? 1/2 Provides information base to monitor and assess an activity s progress and effectiveness during implementation and after the activity is completed. Measures impact /change over time that can be directly/indirectly attributed to project interventions. 2/17/

11 Baseline Study - Why? 2/2 Focuses on the expected results of an intervention, i.e. gathers information related to the different levels of the results chain. (Intended) Looks at secondary changes, both negative and positive, that have not been intended by the programme. (Unintended) 2/17/

12 SA BS Situational Analysis : aims at describing problems and needs within an area, and identifying local resources available to do something about them. Baseline Study : primarily quantitative and requires that the programme already has identified indicators that are going to be measured. 2/17/

13 Baseline Study - When? Before actual activities start so as to assess exact level of indicators at initial stage. This makes it easy to compare with the outcome and impact level indicators in the programme's logical framework. A baseline study should meet the needs and interests of key stakeholders. 2/17/

14 Steps in SIA Step 1: Define the Impact Area (Geographical) Step 2: Identify Information/Data Requirements - their Sources Step 3: Involve All Affected Stakeholders Step 4: Conduct Screening (Identify important areas of difference) Step 5: Carry Out Scoping in the Field Step 6: Prepare a SEE Profile of Baseline Condition Step 7: Survey of Host Population Step 8: Identify and Assess the Impacts Step 2/17/2012 9: Develop a Mitigation Plan 14

15 Information Needs When establishing a baseline, information is gathered on: current conditions (S/E/E parameters) current and expected trends effects of proposals already being implemented effects of other foreseeable proposals 2/17/

16 Scoping To identify the key issues of concern related to the proposed action at an early stage in the planning process. Involves all interested parties -- proponent, Govt agencies and members of the public. Who is concerned? What are their concerns? Why are they concerned? What is the threshold of concern where change becomes unacceptable? 2/17/

17 Scope of Work Scope of Work : defines the work activities, deliverables and timeline for performance of specified work and the accountability. 2/17/

18 Baseline Plan Baseline focus Indicators Data collection methods Data source and quantity Location of data collection Conflict considerati ons Means of analysis Time needed Change/ Expected results Impact Outcomes Outputs 2/17/

19 How? Logical Framework Matrix approach produces a matrix which combines the concepts of results-based management and results-based operation design in grid format. 2/17/

20 Information contained in the LFM 2/17/

21 LFM - Description Column 1: design or internal logic of the operation -- hierarchy of what the operation will do (inputs, activities and outputs) and what it will seek to achieve (purpose and goal). Column 2: how the design will be monitored and evaluated by providing the indicators used to measure whether or not various elements of the operation design have occurred as planned. Column 3: the source(s) of information or the means of verification for assessing the indicators. Column 4: the external assumptions and risks related to each level of the internal design logic that is necessary for 2/17/ the next level up to occur.

Activities Deliverab les/outp uts Objective s/outco mes Goal A LogFrame Matrix Example Project Description Indicators Source of Verification Assumptions To contribute to improved health, particularly

22 Activities Deliverab les/outp uts Objective s/outco mes Goal A LogFrame Matrix Example Project Description Indicators Source of Verification Assumptions To contribute to improved health, particularly of under 5s and the general health of the river ecosystem. Incidence of water-borne diseases reduced by 30% by 2012, specifically among low income families who live by the river. Municipal hospital and clinic records collected by mobile health teams. Improved quality of river water. Concentration of e. coli reduced by 20% (compared to levels in 2003) and meets national health and sanitation standards by Monthly water quality surveys conducted by the EPA and the River Authority. -The Clean River legislation is introduced by the EPA and enforced --Up river water quality remains unchanged 1.1 Reduced volume of fecal waste discharged into river 1.2 Reduced volume of household refuse directly dumped into the river system % of household fecal waste is disposed of via latrines or sewage connections Annual sample survey conducted by municipality between 2009 and Waste water treatment meets national standards -fishing cooperatives meet obligations to establish waste collection systems Conduct baseline survey of households Prepare and deliver public awareness campaign Prepare engineering specifications for latrines and expanded sewage network Etc Etc Baseline data (Knowledge Practice Coverage) for household waste management exists Schedule of visits of mobile teams completed Engineering plans approved by Ministry of Public Works Etc month progress report Extension team progress reports Approved project charter from the Ministry of Public Works Etc. -Municipal budgets for improvements to sewage systems remain unchanged.

23 Think Backwards & Act Forwards Results-based approach to design & operation Planning -- Activities Output Outcome Execution -- Activities Output Outcome 2/17/

24 Outcome Indicators SMART Specific clear, simple, single items of info Measurable items that can be quantified Attainable easily and cost-effectively gathered and available Relevant relates to the goal, purpose, component level objectives and outputs of the activity Timely can be collected and analysed quickly to be useful in activity management. 2/17/

25 Impact Assessment A study carried out to determine whether 1. Intervention had the impact that was Intended and not intended 2. Extent of Impact (parameters impacted and degree of impact on each parameter) 2/17/

26 Impact Study - Benefits Identifying Affected Group Allying Fears and Winning Trust Avoiding Adverse Impacts Enhancing Positive Impacts Reducing Costs Getting Approval Faster 2/17/

27 Impact Intended or unintended Level (Individual, Community, Society) Different times (Short term, Medium term, Long term) 2/17/

28 Types of Impacts Submergence of areas (agriculturedependent rural / tribal communities) Forced displacement Boomtowns (uncontrolled influx of construction workers, crime, social evils) Downstream adverse changes in agroproduction systems Loss of Jobs 2/17/

29 Impact Areas of Change Social Demographic, Education, Sociopsychological, Health, work and Life style, Community cohesion Cultural Values, Norms, Beliefs Economic Employment, Income, Living conditions, Savings Environmental Nature, Magnitude, Location, timing, Duration, 2/17/ Significance, Reversibility

30 Impoverishment Risks Landlessness Joblessness Homelessness Marginalization Food Insecurity Increased Morbidity and Mortality Loss of Access to Common Property Social Disarticulation (Loss of mutual help network) 2/17/

31 Mitigation - critical component to prevent adverse impacts from happening to keep those that do occur within an acceptable level Opportunities for impact mitigation will occur throughout the project cycle. 2/17/

32 Mitigation - Objectives find better alternatives and ways of doing things enhance the environmental and social benefits of a proposal avoid, minimise or remedy adverse impacts 2/17/

33 Mitigation - Methods Avoidance Minimization Compensation 2/17/

34 Research Methodology 1/2 Objectives Identifying Outcome Parameters Training Investigators Population Number of groups for data Sampling Representative Simple Random / Stratified Random / Cluster 2/17/

35 Research Methodology 2/2 Tools Schedule, Interview, Observation, Focus Group Discussions Data Quantitative and Qualitative Primary and Secondary Unit of Study Individual or Household Data Collection Fieldwork Data Analysis 2/17/

36 Data Analysis Descriptive Statistics (for Short term effects) Mean, SD, %, Correlation, Charts/Graphs Inferential Statistics (Test Hypothesis) (for Medium & Long term effects) t-test, Z test, F test, Chi sq 2/17/

37 Reports Project proposal Baseline research report Impact study report Factsheets 2/17/

38 A Case Deepak Foundations Impact -- Kanji Veerya First year - Cotton in the to take advantage of the 20% scheme - increased productivity, 2-3 times more Second year Brinjal Has a bore well - training on how to make vermi-compost. Planned to continue taking seeds & increase productivity and savings 2/17/

39 Point to ponder What is washback effect? How do we carry out cost benefit analysis? How do we know the economic value of the tangible and intangible outcomes? How often & how long should we measure impact? (Retention & Naturalization) 2/17/

40 Thank You 2/17/

Il Project Cycle Management :A Technical Guide The Logical Framework Approach

European Institute of Public Administration - Institut européen d administration publique Il Project Cycle Management :A Technical Guide The Logical Framework Approach learning and development - consultancy