What relevant lessons emerged from this pilot can inform future UNV projects in similar areas/ countries? 4.2. Effectiveness

Transcription

1 Terms f Reference (TOR) Natinal Cnsultant t Evaluate the Prject: Supprt t Palestinian Refugees summer cmmunity-based initiatives UNV-UNRWA Lebann ( ) 1.1. Backgrund t the UNV Prgramme The United Natins Vlunteer (UNV) prgramme is the UN rganizatin that cntributes t peace and develpment thrugh vlunteerism wrldwide. Vlunteerism is a pwerful means f engaging peple in tackling develpment challenges, and it can transfrm the pace and nature f develpment. Vlunteerism benefits bth sciety at large and the individual vlunteer by strengthening trust, slidarity and reciprcity amng citizens, and by purpsefully creating pprtunities fr participatin. UNV cntributes t peace and develpment by advcating fr recgnitin f vlunteers, wrking with partners t integrate vlunteerism int develpment prgramming, and mbilizing an increasing number and diversity f vlunteers, including experienced UNV vlunteers, thrughut the wrld. UNV embraces vlunteerism as universal and inclusive, and recgnizes vlunteerism in its diversity as well as the values that sustain it: free will, cmmitment, engagement and slidarity Backgrund t the prject cmpnent t be evaluated The Supprt t Palestinian refugees summer cmmunity-based initiatives with UNRWA Lebann pilt (The Prject) was implemented between June and September 2016, during schl break, with the ultimate gal f strengthening the capacities f Palestinian refugees thrugh meaningful engagement in cmmunity life in rder t start building mre resilient and self-reliant refugees cmmunities in matters related t their daily lifes. The Prject build n the success f the histric breakthrugh UNV achieved in 2015 jintly with UNRWA- Lebann where 103 natinal UN Vlunteer Teachers (Palestine refugees) were deplyed t enable the agency absrb the additinal case lad f Palestine Refugees frm Syria (PRS) students fr schl year. The Prject s main beneficiaries are grade 1 students mthers and grade 7 t 12 students, bth bys and girls. The fllwing activities were implemented in 5 Palestine refugee camps in the Nrth, Bekaa, Beirut and the Suth: Selectin f 20 natinal UN Vlunteers Teachers (5 in each camp) and mbilizatin f cmmunity vlunteers; Strengthening the capacity f the UN Vlunteers and cmmunity vlunteers t implement the delivery f awareness raising sessins; Implementatin f awareness raising sessins t grade 1 students mthers n literacy, numeracy and health educatin; Implementatin f awareness raising sessins t grade 7 t 12 students, bth bys and girls, n health educatin. The key partners invlved in this pilt interventin is UNV and UNRWA Lebann.

2 2. JUSTIFICATION The term f the Prject came t an end n 30/09/2016; UNV and UNRWA have accrdingly decided t undertake an evaluatin f the Prject. The evaluatin will assess the results and lk at hw t engage in a lnger term partnership t mbilize vlunteers during schl-year break t scale-up vluntary cmmunity activities arund all UNRWA schls in Lebann. It will als serve as a basis fr brader rganizatinal learning. 3. OBJECTIVES AND SCOPE General Objective: Assess the relevance, effectiveness, impact and sustainability f the Prject, draw lessns and make recmmendatins fr future prjects in similar cntext (e.g. shuld it be scaled up and/r replicated and if s, hw). Specific bjectives: T generate knwledge abut best practice n hw t engage in a lnger term partnership with UNRWA Lebann t mbilize UN Vlunteers during schl-year break T identify ways t maximize psitive impacts f vlunteerism in case f scaling-up, replicatin in prjects with similar cntext, cuntries r gegraphical areas Scpe: This evaluatin will fcus specifically n the pilt Prject implemented in the fllwing Palestinian refugee camps: Nahr el Bared (Nrth), Burj El-Barajneh (Beirut), Ein el Helweh (Saida), Burj Shemali (Tyre), Wavel (Bekaa). 4. KEY AREAS /ISSUES TO BE ADDRESSED This evaluatin must address the fllwing criteria: 4.1. Relevance External cherence: The extent t which the bjectives and design f the prject are suited t lcally defined stakehlders needs and pririties. Was the prject develped t address and did it implement the right things? Des the prject implementatin and management benefit cmmunity members in the target areas? T what extent are the bjectives and utputs f the prject still valid? What activities are recmmended t cntinue, strengthen, adapt/? Which are the cnstraints under which the pilt initiative functined? Internal cherence: The extent t which the bjective and design f the prject are suited t UNV s strategic gals and pririties. What relevant lessns emerged frm this pilt can infrm future UNV prjects in similar areas/ cuntries? 4.2. Effectiveness

3 A measure f the extent t which the prject has attained, r is expected t attain, its majr relevant bjectives. T what extent were the bjectives f the prject achieved? What indicatrs demnstrate that? What were the majr factrs influencing the achievement r nn-achievement f the bjectives? Is cmmunity vlunteerism an effective apprach/mechanism t prmte engagement at the refugee cmmunity level? Why r why nt? 4.3. Efficiency A measure f hw ecnmically resurces/inputs (funds, expertise, time, etc.) are cnverted t results. Efficiency measures the utputs qualitative and quantitative in relatin t the inputs and usually requires cmparing alternative appraches t achieving the same utputs, t see whether the mst efficient prcess has been adpted. Were the activities cst-efficient? Were bjectives achieved n time? Was the Prject implemented the mst efficient way cmpared t alternatives that d nt include UNV participatin? 4.4. Impact/ Effects The psitive and negative changes prduced by a develpment interventin, directly r indirectly, intended r unintended. This invlves the main impacts and effects resulting frm the activity n the lcal scial, ecnmic, envirnmental and ther develpment indicatrs. The examinatin shuld be cncerned with bth intended and unintended results and must als include the psitive and negative impact f external factrs, such as changes in terms f trade and financial cnditins during the interventin. What has happened as a result f the prject? What real difference have the activities made t the beneficiaries? What were the mst significant changes that the Prject has helped t generate? Hw many peple have been affected? What types/kinds/grups f peple have been affected and may be impacted after the prject? The evaluatin f effects and impact needs t be realistic taking int cnsideratin that mst develpment interventins have an attributin challenge, as develpment results and changes can very rarely be attributed t the actins f ne particular actr. In the case f UNV, this is very ften the case, as UNV wrks in cllabratin with ther partners in the field. While the added value f UNV and vlunteerism can and shuld be highlighted in every evaluatin, it is imprtant that the reprt takes int cnsideratin and credits ther UNV Partners inputs as well as the UN Vlunteers Sustainability A measure f whether the benefits f defined activity is likely t cntinue after dnr funding has been withdrawn and the Prject has ended. Prjects need t be envirnmentally as well as financially

4 sustainable. External factrs (plitical, institutinal, ecnmic, technlgical, sci-cultural and envirnmental) affecting sustainability shuld als be cnsidered. What are the majr factrs which influence the sustainability f the prject? T what extent was UNV s financial investment in this pilt attractive t generate future resurces in terms f funding sustainability? Cnsidering the small magnitude f the pilt? 4.6. Vlunteerism UNV recgnizes that vlunteering means different things t different peple and that there is a wide range f ways t prmte vlunteerism. Within this cntext, the evaluatin shuld cver different aspects f vlunteering. What is the distinctive cntributin r added value f UN Vlunteers t the utcmes f the prject? Withut the invlvement f UN Vlunteers, what wuld have been different? Wuld the utcme/ impact have been the same, slwer, negative, nt happened at all? Hw did UNV in the prject cntribute t stimulating lcal vlunteerism? Hw did the prject cntribute t cmmunity empwerment and civic engagement f peples living in the 5 targeted Palestinian refugee camps? What were the helping and hindering factrs t the stimulatin f vlunteerism in the prject? 4.7. Other evaluatin criteria There are ther themes and areas that are cmmnly included in prject design, and shuld be taken int cnsideratin during evaluatins. Fr instance, as part f UNV s strategy, prjects and prgrammes are usually dne in partnership and crdinatin with ther develpment actrs, include gender and human rights perspectives, and have strng participatin and capacity develpment elements. These tpics shuld t the extent apprpriate be part f the evaluatin and specifically included in the evaluatin reprt. Partnerships Reflectin n the institutinal relatinships develped thrughut the prject and the extent t which they have cntributed t the achievement f results. Wh were the partners invlved in the design and implementatin f the prject (UN, gvernment, internatinal NGOs, lcal rganizatins, etc)? What value did the different partners add? What were the key factrs cntributing t building gd partnerships during implementatin f the prject? Gender Hw can key partnerships, especially with UNRWA, be strengthened in the future? Whether and t what extent the prject tk the gender dimensin int accunt and whether it prmted a gender sensitive apprach t frmulatin and implementatin. It als invlves practical measures t guarantee an adequate treatment f gender issues in the prject, beynd equal participatin by men and wmen, and addressing changes in attitudes and behaviurs.

5 Did the prject fllw a gender sensitive apprach? What was the level f participatin f men and wmen in the prject? Did the prject wrk specifically with wmen s grups and rganizatins? Was this an effective apprach? Did the pilt address inclusin f yung Palestinian girls and wmen grups within the beneficiary cmmunities f the camps? Human Rights Whether and t what extent the human rights dimensin was taken int accunt, and if the prject prmted a rights-based apprach t frmulatin and implementatin. Did the prject have a specific scial inclusin apprach? Are there any actins prmted by the prject that demnstrate that vlunteerism can supprt scial inclusin? Capacity Develpment This criterin measures the extent t which the prject has supprted the creatin and/r develpment f lcal, rganizatinal and individual capacities in target/related prject participants (including rangers, cmmunities, natinal UN Vlunteers). Did the prject have a specific capacity develpment apprach? What were the key elements f this apprach? Wh was the target grup f the capacity develpment apprach? Were the capacity develpment actins adequate t the needs and expectatins f these target grups? What were the specific capacity develpment activities prmted by the prject? What were the mst significant results f these activities? T what extent did the vlunteer element f actins prmted by the prject influence the develpment f capacities? Stakehlder invlvement and participatin This criterin measures the extent t which the prject has prmted participatry appraches, used participatry tls r ther means t prmte the invlvement f stakehlders at different levels and stages f the prject cycle. What was the strategy used by the prject t engage and invlve stakehlders in the different stages f the prject? Was this strategy effective? Did it have a psitive, negative r neutral effect n the achievement f results? Are there any participatry tls used in the prject that are wrth being cnsidered fr future UNV s shrt-prgramme interventins? What is the funding rati, ut f the ttal allcatin made by the participating partners t this pilt? Was the financial investment made by the UNV attractive t generate additinal prgramme funding fr replicatin f the same pilt in future summer camps? 5. METHODS AND APPROACHES

6 The evaluatin will use the fllwing methdlgy t generate evidence and t maximize learning frm all relevant stakehlders and surces f infrmatin: Desk review Stakehlder mapping Briefing meetings and interviews with key prject infrmants, including the UNV Field Unit team, the UNRWA Lebann Educatin Prgramme, UNRWA Area Educatin Officers, natinal UN Vlunteers, cmmunity vlunteers Skype cnference with the Senir Prtfli Manager fr the Arab States at UNVHQs; Suggest visit t the prject site, and fcus grups meetings with stakehlders Presentatin f final evaluatin t UNV Evaluatin cnsultant will be held t the highest ethical standards and are required t sign a Cde f Cnduct upn acceptance f the assignment. UNDP evaluatins are cnducted in accrdance with the principles utlined in the UNEG 'Ethical Guidelines fr Evaluatins' and based n UNDP Updated Guidance n Evaluatin (2011) and the riginal Handbk n Planning, Mnitring and Evaluating fr Develpment Results (2009). Additinal infrmatin can als be fund n the UNDP Evaluatin Website ( 6. EVALUATION PROCESS Inceptin stage: Desk review f all relevant dcumentatin related t the prject, including plicy and prgrammatic dcuments, and mnitring reprts. Stakehlder mapping t determine wh shuld be cnsulted, what evaluatin questins shuld be addressed t them, and what tls are mre effective t generate infrmatin with each different target grup Briefing meetings and interviews with UNV cuntry team and UNV prject management t finalize evaluatin design. Preparatin f inceptin reprt: the inceptin reprt will take advantage f the cnsultant s experience in M&E, and will be based n the cnclusins f the inceptin stage. It shuld particularly lk at the evaluatin questins (and refine them as apprpriate), data surces and data cllectin methds. Data cllectin and generatin stage: Evaluatin missin: visit t the lcatins where the prject is implemented. During the missin, the fllwing tls can be applied fr data cllectin and generatin: Analysis and reprting stage: Fcus grups meetings with stakehlders Site visits t areas where the prject is implemented Interviews with key infrmants

7 Preparatin f missin aide-memire: a detailed descriptin f the evaluatin missin including activities carried ut, peple met, and issues t be cnsidered in the evaluatin reprt Preparatin f draft evaluatin reprt, 2-page evaluatin brief & recmmendatins matrix Feedback n draft evaluatin reprt and evaluatin brief frm UNV (Field Unit and HQs) Presentatin f final evaluatin reprt t UNV FU & HQs thrugh Skype fr business Steps in the evaluatin prcess Desk review and stakehlder mapping Preparatin f inceptin reprt and detailed plan f cuntry data cllectin Evaluatin missin (including travel time) t prject sites Preparatin f missin aide-memire, draft evaluatin reprt, 2-page evaluatin brief & recmmendatins matrix Feedback frm UNV t cnsultant n evaluatin reprt, evaluatin brief and recmmendatins matrix and necessary changes Presentatin f final evaluatin reprt Ttal: Estimated # f wrking days 1 day 2 days 3 days 2 days 3 days 1 day 12 Days Deadline fr cmpletin Once dates have been cnfirmed, a detailed plan fr the evaluatin missin will als need t be prepared in crdinatin with the UNV Field Unit team. 7. OUTPUTS Expected utputs fr this evaluatin are: Inceptin reprt including: Evaluatin matrix with key questins, indicatrs and means f verificatin Detailed infrmatin n evaluatin methds and tls t be used Evaluatin wrk plan Aide memire f evaluatin missin Draft and final evaluatin reprt with executive summary that can be used as stand-alne dcument Tw-page evaluatin brief Recmmendatins / management respnse matrix ( 8. MANAGEMENT OF THE EVALUATION The verall respnsibility fr managing the evaluatin will be with the UNV Field Unit. It will ensure clse cllabratin with ther UNV stakehlders including HQ. The invlvement f majr stakehlders at the

8 cuntry level (including UNDP, UNRWA and thers) shuld be ensured and maintained thrughut the entire evaluatin prcess. 9. REQUIREMENTS The assignment will be cntracted t a natinal cnsultant with experience in the substantive area and knwledge f vlunteerism. The Cnsultant shuld have: University degree at the pst-graduate level (preferable an MA/MSc.) in the scial sciences, develpment, management r ther relevant field f study; 7 years wrk experience f which at least three in a develping cuntry; Knwledge and experience with UNDP s results-based evaluatin plicies and prcedures, is an asset; Knwledge f the Palestine refugees cntext in Lebann, is an asset; Prven track recrd and experience in evaluating develpment interventins; Knwledge and experience f vlunteerism with its diverse manifestatins and cultural settings; Demnstrable analytical skills and reprt-writing skills; Excellent, prven management and cmmunicatin skills; Prficiency in English and Arabic, French is a plus. 10. DURATION OF CONTRACT The ttal duratin f the evaluatin will be 12 days spread ver Dec-2016/Jan DELIVERABLES All deliverables shuld be written in English and submitted in ne riginal and ne cpy including ne sft cpy n CD, as per the belw: Deliverable Cntent Timing Respnsibilities Inceptin Reprt Methdlgy and N later than 1 week pst Cnsultant submits t UNV schedule cntract signature Field Unit fr review by bth Missin Reprt Minutes f meetings N later than 1 week pst missin cmpletin Draft Evaluatin Reprt Full reprt with annexes Within 2 weeks pst missin cmpletin Final Reprt* Revised reprt Within 1 week f receiving UNV cmments n draft UNV HQs and Field Unit The Cnsultant is expected t meet the different parties in their respective premises; the UNV Field unit will set up stakehlder interviews Cnsultant submits t UNV Field Unit fr review by bth UNV HQs and Field Unit

9 The UNV HQs and Field Unit shall subsequently have five (5) wrking days t review the first tw deliverables and frward cmments t the cnsultant; and ten (10) wrking days fr the 3 rd and 4 th deliverables. The prject manager reserves the right t request additinal evaluatin time if ther infrmatin r clarificatin is further needed. Payments will be issued upn satisfactry cmpletin f the required utputs. 12. PAYMENT TERMS % Milestne 20% Fllwing submissin and apprval f inceptin reprt 20% Fllwing submissin and apprval f missin reprt 30% Fllwing submissin and apprval f the draft evaluatin reprt 30% Fllwing submissin and apprval f the final reprt