Monitoring and Evaluation of Reconstruction Activities

Transcription

1 Government of Nepal Ministry of Urban Development Central Level Project Implementation Unit Earthquake Housing Reconstruction Project (EHRP) Monitoring and Evaluation of Reconstruction Activities Er. Kiran Kumar Mahat Monitoring and Evaluation Consultant Sindhuli and Okhaldhunga 1

2 Monitoring and Evaluation Monitoring is the collection and analysis of information about a project or program, undertaken while the project/program is ongoing. Evaluation is the periodic, retrospective assessment of an organization, project or program that might be conducted internally or by external independent evaluators. 2

3 3

4 MOUD- CLPIU FUNCTIONS Support through DLPIU in 14 affected Districts Inspection and certification of rural and urban Housing built through owner driven approach and built back better concept Train mason and house owner and technician about Earthquake Resistant Technology 4

5 Functional Modality MOUD CLPIU Project Director, Deputy Project Directors / Chief Finance Controller M & E Specialist - Central NRA DLPIU M & E Specialist - Districts POs Support to Earthquake affected house owners for build back better & Train Mason, HHs and Technicians. 5

6 Main Activity Monitor and evaluate the training activities conducted by the CLPIU / DLPIUs / Partner Organizations. Support MOUD in monitoring and evaluation of owner driven housing construction. 6

7 Specific Activities Develop and implement M & E framework with detail Log Frame. Coordinate with NRA, POs, GOs and Earthquake Affected Households. Conduct periodic site visit of owner driven housing construction in earthquake affected region. Inspection and monitoring of housing construction and training activities by various partner organizations. 7

8 Specific Activities Collection and Consolidation of data related to owner driven housing construction and training activities and report to MOUD-DLPIU/ CLPIU and NRA. Design and development of M & E methods, M & E tools and implement/ timely modify it. Carrying out training need assessments. Provide technical assistance/ Advices related to Monitoring and Evaluation. 8

9 Specific Activities Be the focal person at MOUD- CLPIU/ DLPIU for coordination between project level M & E and EHRP program level M & E. Develop and maintain a M & E database for the project and contribute to the maintenance of a database of EHRP project. Coordinate and cooperate with NRA and all Stakeholders for promoting and information sharing on all aspects related to project activities. 9

10 Specific Activities Ensuring mentoring and training of project team to foster capacity building on M & E knowledge. Review monitoring and evaluation system/ mechanism, process and procedures of the project and forms and formats for project activities under its various components. Monitor project progress through field visit, offer feedback and keep regular communication with related field and center level staff. 10

11 Specific Activities Focal point for providing M & E inputs on Implementation Progress Reports (IPRs). Prepare and submit M & E inputs as per the Results Framework to the consolidated trimester/ annual project implementation progress as per the requirement of project and World Bank. 11

12 Inspection and certification of rural and urban Housing built through owner driven approach and built back better concept MOUD - CLPIU Reconstruction Framework Function Input Process Output Outcomes Engineers, Sub Capacity Development of Engineers. Timely updated Database Engineers and Asst Inspection of Houses. / Compliance houses Sub Engineers (Hiring Awareness Campion for safer construction. increased. with Motivational Input to database Packages) Timely fill up forms and formats. Reporting to Village Council and DLPIU. Coordination POs/ GOs./ HHs Policies, Guidelines Designs, Drawings/ Catalogues/ Manuals / Awareness Creating Materials DLPIUs / NRA district Dissemination of Policies and guidelines. Implementations of Policies and guidelines. Feedbacks and rectifications. Disseminations, Implementations, getting Feedbacks and corrections according to NBC. Deployment of Engineers. Follow up Engineers performance. Reporting MoFALD/ CLPIU and others Coordination POs/ GOs. Partner Organizations Reconstruction programs. Training programs. Supports to Earthquake victims. Livelihood programs Other infrastructure development programs. Public aware about Policies and Guidelines. People are encouraged to safer construction and built back better. Safer and better houses in District / Compliance houses increased Recovery from the disasters/ safer better houses Safer infrastructure to resist disasters with better lives of people. 12

13 Training mason and house owner and technician about earthquake Resistant Technology MOUD - CLPIU Reconstruction Framework Function Input Process Output Outcomes Training Venues Training Materials (Hardware) Trainers/ Training Managers Training hall. Workshop. Sample house construction. Uses of Training Materials as per Curriculum. Quality Training delivery as per curriculum. Training Plan, Lesson Plan, Log Book, Visitors feedback, Attendance. Evaluation of Participants. Training Evaluation/ feedback. Management of training. Skill Testing. Curriculums Appropriate Uses of Training Curriculum Training Materials (Software) Training Participants (DUDBC/ CTEVT). Uses of Training Materials developed by DUDBC/ CLPIU/ NRA/ CTEVT and others. Selection of Training Participants as per DUDBC/ CLPIU/ CTEVT requirements. Skilled Workers in Earthquake Resistance Building Construction fulfilled. Self Employment and Living standard of the people increased. 13

14 Monitoring Framework 1. Inspection and certification of rural and urban Housing built through owner driven approach and built back better concept. Engineers, Sub Engineers and Asst. Sub Engineers (Receive the information from DLPIU, DLPIU focal person, Engineers, MIS database, Community HHs and different authentic medium). VDC wise data of Engineers, Sub Engineers and Asst. Sub Engineers and find gap if there is some post are vacant. Attendance of Engineers in the VDC and their effort in earthquake resistance building construction and housing inspection to distribute housing grant. HHs received housing grant 1 st installment/ No of houses started to construct/ No of houses eligible to receive 2 nd installment/ No of Grievance handling and passed in Grievance handling in each VDC. Capacity development of Technical personnel. Positive Trends in safer house construction/ housing grant distribution. Improvements needed in safer house construction/ housing grant distribution. 14

15 Monitoring Framework DLPIU (Receive the information from DLPIU Chief, Deputy Chief, Focal Person, other Engineers and Staffs, MIS database, NRA, POs and Community HHs) Human resources (Engineers) working in reconstruction. Existing Monitoring and communication Mechanisms of HR. Physical and financial resources. Coordination between GOs in reconstruction. POs working in the districts. Coordination with POs. Positive Trends. Improvements needed. 15

16 Monitoring Framework Partner Organizations (Receive the information from POs - first individual PO and conducting all PO s meeting/ DLPIU Chief, Deputy Chief, Focal Person, other Engineers and Staffs, MIS database, NRA and Community HHs). Programs related to reconstruction (housing, training, livelihood, infrastructure development and others) Human resources working in reconstruction from PO. Physical and financial resources. Coordination with CLPIU/ CLPIU Engineers in Field/ other GOs./ other POs. Positive Trends. Improvements needed. 16

17 Monitoring Framework Dissemination and availability of Housing Reconstruction Materials (Receive the information from DLPIU and Community HHs). Policies, laws, guidelines, standards related to Reconstruction. Design Catalogues and other revised building designs. Public awareness materials. Inspections forms and formats. Use of FM Radio, TV, Newspapers and other Medias for safer building construction. Positive Trends. Improvements needed. 17

18 Monitoring Framework 2. Training mason and house owner and technician about earthquake Resistant Technology. (Visiting the Training Activities the information from direct observation will be based / necessary tools to note the observations will be developed accordingly for each component). Training Venues Training hall. Workshop. Sample house construction. Comments and Suggestions. Training Materials (Hardware) Uses of Training Materials as per Curriculum. Comments and Suggestions. 18

19 Monitoring Framework Trainers/ Training Managers Quality Training delivery as per curriculum. Training Plan, Lesson Plan, Log Book, Visitors feedback, Attendance. Evaluation of Participants. Training Evaluation/ feedback. Management of training. Skill Testing. Comments and Suggestions. Curriculums Appropriate Uses of Training Curriculum (DUDBC/ CTEVT). Comments and Suggestions 19

20 Monitoring Framework Training Materials (Software) Uses of Training Materials developed by DUDBC/ CLPIU/ NRA/ CTEVT and others. Comments and Suggestions. Training Participants Selection of Training Participants as per DUDBC/ CLPIU/ CTEVT requirements. Comments and Suggestions. Training Need Assessment 20

21 Monitoring Activities Observations/ Inspections. Collect information from Engineers. Information from Households. Interactions with Stakeholders. Data collection. Progress Review Data Analysis, Preparation and submission of Monthly Report. Take Action through MOUD- CLPIU/ DLPIU/ NRA. 21

22 Recent Performance of M & E Team in Coordination of CLPIU/ DLPIU/ NRA Development of Monitoring Framework. Meeting with DLPIU officials in the districts. Coordination meeting with Partner Organizations in Districts. Monitoring of training/ reconstruction activities performed by POs. Collection of the Status of Tablets for data collection. 22

23 Master Training of Trainers on Retrofitting Techniques and Correction/ Exception Manual. Training on Retrofitting Techniques and Correction/ Exception Manual ongoing in 6 districts center. Development of Monitoring tools on input and process monitoring ongoing. 7 days Mason Training for 2334 existing Masons in 14 districts. Training on Building Inspection and public Procurement. 23

24 Sample Tools developed for M & E Ministry of Urban Development Central Level Project Implementation Unit (CLPIU) Follow up questionnaire for Reconstruction Update (Please, provide the following information as accurate as possible. This will help us to make the reconstruction activities more effective and efficient) Your name: Your Village/ Municipality where you work: Ward Number and Name of Tole: Designation: 1. How many Earthquake affected House Owners are their in your working area? Provide approximate number How many of them will construct what types of houses in your general observation? Write it in percent. RCC A&B % SMM-C % SMC-C % BMM-C % BMC-C % RCC-C % Other Designs % 2. How many of them started the construction of Houses? Provide approximate number How many of them are constructing what types of houses? Write it in number. RCC A&B SMM-C SMC-C BMM-C BMC-C RCC-C Other Designs 3. In your general observation, how many Earthquake affected house owners in your working area will not construct the house? Write it in Percent. % 4. What are the main causes of not starting the construction of Houses? What should we do to motivate the house owner for starting the construction of Houses? Is there sufficient number of Skilled Masons for the construction of Houses? a. Yes b. No 7. If not, How the House Owners is building their houses? Are their Mason Trainings conducted in your working area? a. Yes b. No 9. If yes, which organizations conducted the Mason Trainings? How many partner organizations (NGOs/ INGOs/ GOs) are working in Reconstruction in your working area? Provide the Name of partner organizations and activities they are doing? a. Name: Activities b. Name: Activities c. Name: Activities d. Name: Activities 2. Are you satisfied in the work of partner organizations (NGOs/ INGOs/ GOs)? a. Fully Satisfied b. Satisfied c. OK d. Not Satisfied 3. What we should do to make the effective mobilization of partner organizations (NGOs/ INGOs/ GOs)? How frequently you will be present in your Working Area? a. Once a week b. twice a week c. As per demand d. Always 5. Are you satisfied with the activities of MOUD-CLPIU and DLPIU? a. Fully Satisfied b. Satisfied c. OK d. Not Satisfied 6. Are you satisfied with the activities of NRA? b. Fully Satisfied b. Satisfied c. OK d. Not Satisfied 7. What are your expectations and suggestions for MOUD-CLPIU/ DLPIU and NRA to make effective Reconstruction? The following space is for you to write your Views, Opinions, Suggestions and Experiences related to Reconstruction. Please write, if you have to tell more about Reconstruction Thank you for provide invaluable opinions for reconstruction. It will help us for effective and efficient Reconstruction in near future. 24

25 Ministry of Urban Development Central Level Project Implementation Unit (CLPIU) Training on Retrofitting Techniques and Correction /Exception Manual Training Evaluation from Participants Read the following statements carefully and round your choice. Your proper feedback will help us to make the further training more effective. 1. What do you think about the training venue and time? a. Excellent b. Very Good c. Good d. Not Good 2. Did you receive the information of this training on time? a. Yes b. No 3. The quality of the presentations of the trainers were: a. Excellent b. Very Good c. Good d. Not Good 4. Are the contents of the training useful to you? a. Very useful b. Useful c. Not useful d. I don t have idea. 5. Do you think this training will be useful to the Engineers working in the Reconstruction? a. Very useful b. Useful c. Not useful d. I don t have idea. 6. Are you satisfied from this training? a. Extremely Satisfied b. Satisfied c. Not Satisfied d. Don t know 7. Overall management of the training was: a. Excellent b. Very Good c. Good d. Not Good 8. Provide your comments and suggestions related to this training below: (Thank you for your constructive Feedback) Introduction to Correction and Exception manual 25

26 Ministry of Urban Development Central Level Project Implementation Unit (CLPIU) Training on Retrofitting Techniques and Correction /Exception Manual Training Content Evaluation The topics delivered in the training are written below. Based on your personal experience, observations and your understandings in the training, provide your rating scale from 1 to 5 for each topics of the training: Minimum Scale Not So Satisfactory Maximum Scale Excellent S.N 1 Course Introduction Content Overviews (Policies, Guidelines etc.) 2 Introduction to Correction/ Exception Manual with major Non Compliance issues 3 Correction / Exception (Site Selection, shape and material for masonry buildings) 4 Correction / Exception (Foundation, Vertical Member and wall) 5 Correction / Exception (Plinth Beam, doors and window, horizontal band and roof) 6 Alternative Technologies / inspection, design catalogue 2 7 New RCC Type Designs prepared by MoUD - CLPIU, low cost house designs 8 Confined Masonry 9 Revised Inspection Forms/ Implementing Correction Manual 10 Seismic retrofitting guidelines 11 Cases for Non Compliance in housing reconstruction 12 Inspection App (The World Bank) 13 Retrofitting Buildchange Provide Rating Scale 1 to 5 Training Delivery (Presentation) Content Expertise Dealing with Questions Remarks Introduction to Correction and Exception manual 26

27 Government of Nepal Ministry of Urban Development Central Level Project Implementation Unit Monitoring Checklist for 50 days On the Job Mason Training 1. Basic Information of Training: Name of TSP: Training Venue: VC/Municipality/Ward: District: Start Date of Training: Expected Date of Completion: No. of Trainees in Monitoring Time: Female Training Time: from to Name of District Coordinator: Name of Engineer: Name of Sub Engineer: Name of Skilled Mason: Male. No. of Days of training on monitoring date 2 Model House and Construction Work: SN Description Status Comment Yes No 1 Is the location of house is appropriate? 2 Is there sufficient learning opportunities? 3 Supply of Materials is on time by house owner. 4 The quality of work is good. Model house construction progress is satisfactory. 5 House owner is happy with the house construction. 3 Materials, Tools and Equipment: SN Description Yes No Comment 1 Quantity of tools and equipment is sufficient. 2 Quality of tools and equipment is good. 3 Quality of consumable training materials is good. 4 Training Delivery: SN Description Yes No Comment 1 Active participation of trainees in model house construction. 2 Trainees are receiving good Knowledge and Skills in model house construction. 3 Trainees are satisfied with the trainers. 4 Safety measure used. 5 Tools/equipment is used properly 6 Trainers are very clear to the model house construction. 7 Periodic evaluation of trainees done 5 Training Resources: SN Description Status Comment Yes No 1 Training Curriculum available 2 Trainers Session Plan & Log Book 3 Adequate Stationery for Trainees 4 Attendance for Trainees 5 Management of Fact Sheet and Banner 6 Visitor's Log Book 6 Performance of Training team: SN Description Yes No Comment 1 Role of District Coordinator is good. 2 Role of Engineer is good. 3 Role of Sub Engineer is good. 4 Role of Skilled Mason is good. 7 Assessment of Trainee's Learning: SN Description Yes No Comment 1 Questions asked to the trainees by trainer 2 Were the Trainees asked if they had any questions 3 Trainees learnt the purpose of the lesson 4 Confident on skills developed by the lesson(s) Comments from Trainee: Comments from Trainer: Commitments of TESP: Comments from Monitor: Monitored by:...signature:... Introduction to Correction and Exception manual 27

28 Training: Monitoring Checklist Sr. No. Process 1. Trainer s capacity a. Qualifications b. Facilitation skill Adequate (Yes) Inadequate (No) Observation and remark for inadequate answers ( No) 2. Training curriculum and Content 3. Training plan/schedules 4. Time of the Training 5. Training center Facilities a. Classroom setting b. Training Materials c. Training Record keeping d. Training Norms e. Food during training f. Drinking water g. Toilet facilities 6. Selected Participants 7. Group size of Training 8. Participant s opinion a. On trainers ability b. Location of training center c. Training facility d. Timing of training 9. Any other observations Introduction to Correction and Exception manual 28

29 Monitoring Team S N Name Mobile 1 Dr. Diwat Kumar Shrestha Team Leader Central 2 Janak Raj Joshi Ramechhap/ Dolakha 3 Khagendra Awasti Gorkha/ Dhading 4 Kiran Kumar Mahat Sindhuli/ Okhaldhunga 5 Narakanta Sapkota Kathmandu/ Bhakatpur 6 Prabhu Ram Pokheral Rasuwa/ Nuwakot 7 Roshan Giri Lalitpur/ Makawanpur 8 Roshan Keshari Kavre/ Sindhupalchowk

30 Thank You 30