PURCHASE FOR PROGRESS INDICATOR REFERENCE

Transcription

1 PURCHASE FOR PROGRESS INDICATOR REFERENCE Prepared by World Food Programme and Management Systems Internatonal MANAGEMENT SYSTEMS INTERNATIONAL A Subsdary of Coffey Internatonal, Ltd. Verson 3, September 27, 2010

2 Table of Contents INTRODUCTION 1 INDICATOR REFERENCE SHEETS Impact Partcpatng smallholder/low ncome farmers' average annual household ncomes. Number of partcpatng smallholder/low ncome farmer s wth average annual household ncome mprovements of at least $50. Outcome 1.1 Number of completed complatons (by WFP) of best practce programmng and polcy recommendatons from P4P. Output Completed global level M&E system ncludng M&E plan, mplementaton gudelnes, M&E manual, and analyss and reportng routnes/templates. Number of P4P plot countres mplementng M&E system (e.g., collectng data, producng requred reports, etc.). Output Percentage of requred M&E reports delvered to, or developed by, P4P Unt. Output Average percentage of nvted/expected organzatons represented at event/meetng. Outcome 1.2 Number of partcpatng stakeholders that have ncorporated best procurement and market development recommendatons nto ther operatons, procedures, or polcy documents. Output Number of publcatons, or other communcatons, produced by WFP that contan specfc programmng or polcy recommendatons (e.g., gudance to country offces, poston papers, polcy recommendatons, etc.) Number of meetngs of agrcultural development stakeholders at whch ether polcy or programmng proposals are tabled by P4P mplementers Purchase for Progress Indcator Reference For Internal Use Only

3 Outcome 2.1 Average per farm marketable surplus of staple commodtes produced by smallholder members of partcpatng farmers organzatons. Average per farm quantty of staple commodtes sold by partcpatng smallholder/low ncome farmers. Average (per smallholder farm) post-harvest losses of staple commodtes as a percentage of annual producton. Output Percentage of partcpatng farmers organzatons for whch WFP has sgned agreements wth partners to mprove agrcultural productvty/producton. Number of smallholder farmer members of partcpatng farmers organzatons traned n mproved agrcultural productvty/producton practces. Output Percentage of partcpatng farmers organzatons for whch WFP has sgned agreements wth partners to mprove post-harvest handlng facltes and practces. Number of smallholder farmer members of partcpatng farmers organzatons traned n mproved post-harvest handlng and storage practces. Outcome 2.2 Average proporton of smallholder members staple commodtes sold through partcpatng farmers organzatons. Average (per regstered member) quantty of staple commodtes sold through partcpatng farmers organzatons. Average (over partcpatng smallholder farmers organzatons) prce receved for commodtes as a percentage of the hghest prce n that localty durng the marketng season. Output Percentage of smallholder/low ncome farmers organzaton management staff who have completed tranng n governance, admnstraton, or fnancal management of farmers organzatons. Output Purchase for Progress Indcator Reference For Internal Use Only

4 Number of farmers organzatons wth at least one member of the management staff traned n organzaton management (.e., governance, admnstraton, or fnancal management of farmers organzatons). Average (over farmers organzatons) percentage of contracts successfully delvered. Number of partcpatng smallholder/low ncome farmers organzatons qualfed to partcpate n WFP compettve tenders. Output Percentage of partcpatng smallholder/low ncome farmers organzaton members who are women. Percentage of partcpatng smallholder/low ncome farmers organzatons elected leadershp postons held by women. Number of partcpatng smallholder/low ncome farmers organzaton members who are smallholder farmers. Percentage change n total membershp of partcpatng smallholder/low ncome farmers organzatons (relatve to baselne and dsaggregated by sex of member). Output Number of partcpatng smallholder/low ncome farmers organzatons wth ablty to offer ther members some form of fnancng for crops at harvest (e.g., by pre-purchase, credt, access to warehouse recept systems, or other full or partal pre-payment for crops). Number of partcpatng farmers organzatons depostng commodtes n a warehouse wth a recept system. Outcome 2.3 Average quantty of staple commodtes sold by partcpatng farmers organzatons. Average sze of sale of staple commodtes by partcpatng smallholder/low ncome farmers organzaton. Average number of dfferent geographc markets sold nto by partcpatng smallholder/low ncome farmers organzatons. Output Percentage of partcpatng smallholder/low ncome farmers organzatons for whch WFP has sgned agreements wth partners to provde market access support. Output Purchase for Progress Indcator Reference For Internal Use Only

5 Number of partcpatng smallholder/low ncome farmers organzatons offerng post-harvest handlng servces to ther members. Number of partcpatng farmers organzatons wth access to warehouse storage capable of mantanng long-term qualty of stored commodtes. Outcome 2.4 Average percentage contrbuton of sale of staple commodtes to household ncomes of partcpatng smallholder/low ncome farmers. Percentage of households wth Poor food consumpton score. 47 Average household asset score (HAS) of partcpatng smallholder/low ncome farmer households. Average annual household expendture (food and non-food) by smallholder farmer households. Percentage of partcpatng smallholder/low ncome farmers who are net sellers of staple commodtes (.e., produce more than they consume). Outcome 3.1 Quantty of food purchased annually by WFP from smallholder/low ncome farmers organzatons. Output Number of P4P plot countres wth a documented plan for achevng the requred growth ncrement. Output Number of P4P plot countres wth documented local-specfc decson rules to mnmze/avod market dstortons. Number of P4P plot countres producng tmely market ntellgence/mpact reports. Output Percentage of country offces wth at least one staff member traned n some aspect of local procurement specfc to P4P. Output Average (over partcpatng farmers organzatons) sales of staple commodtes to processors. Outcome 4.1 Fnancal regulatons and procedures revsed to support local procurement usng P4P modaltes. Job descrptons reflect needs/sklls requred to effectvely manage local procurement Purchase for Progress Indcator Reference v For Internal Use Only

6 Program Gudance Manual revsed to reflect a strategc approach to local procurement. Number of P4P plot country s n whch rsk management strateges explctly acknowledge rsks assocated wth pro-smallholder procurement. Percentage of PRROs, EMOPs, and country programmes that ncorporate pro-smallholder local procurement as a programme component (dsaggregated by country). Output Percentage of pro local procurement polcy proposals presented to WFP s Executve Board that are adopted. Output Percentage of requred Steerng Commttee and Stakeholder Group meetngs convened. Output Percentage of total annual procurement from local sources. 66 Quantty of food procured locally Assessng Impact 68 Dscountng Monetary Values 68 Purchase for Progress Indcator Reference v For Internal Use Only

7 INTRODUCTION The Purchase for Progress montorng and evaluaton system contans 55 ndcators. Because of space lmtatons, the logframe matrx ncludes only ndcator ttles and does not provde the detal necessary to fully understand the complexty of the ndcators. Ths document supplements the logframe matrx wth detaled descrptons of each ndcator. The reference sheets for each ndcator provde a detaled descrpton of the ndcator wth precse defntons of terms, the ratonal for the ndcator, data sources, frequency of data collecton, an assessment of data qualty and lmtatons, and detaled nstructons on how to calculate the ndcator values. The ndcator reference s organzed by programme outcome and output as referenced n the logframe matrx. Purchase for Progress Indcator Reference 1 For Internal Use Only

8 Logframe Component: Impact Indcator (ncludng precse Unt of Measurement): Partcpatng smallholder/low ncome farmers' average annual household ncomes. Unt: Real household ncome (local currency & USD) Objectve: Not relevant. Ths s an mpact-level ndcator and thus encompasses all four objectves. Logframe Component: Impact To facltate ncreased agrcultural producton and sustaned market engagement and thus ncrease ncomes and lvelhoods for partcpatng smallholder/low ncome farmers, the majorty of whom are women. Indcator Descrpton: Annual real net household ncome (from all sources) of smallholder/low ncome farmers who are members of farmer assocatons partcpatng n P4P. The defnton of smallholder farmer wll vary by country. Partcpaton n P4P means that the smallholder farmer has the opportunty to sell to WFP through P4P and s (probably) recevng supply-sde support because of P4P. Ratonale/Crtcal Assumptons for Indcator: Ratonal/Crtcal Assumptons: One of the key goals of P4P s to ncrease the ncomes and lvelhoods of smallholder farmers. Ths ndcator measures progress towards that goal. Attanng ths goal depends crtcally on the entre development hypothess of P4P. Specfc assumptons nclude: WFP s commtment to buy drectly from selected farmers organzatons s suffcent to catalyze addtonal supply-sde support for the organzatons n market development and for the smallholder members of those organzatons n productvty enhancement. P4P ncreases access to markets for partcpatng smallholder farmers and ths s suffcent to prompt ncreased nvestment n agrculture and ncreased producton. WFP s ablty to buy s stable and large enough to provde a sustaned ncentve to produce and sell surplus commodtes. WFP s presence n the market does not cause dstortons that negatvely affect smallholder ncome or lvelhoods. Data Source(s): Farmer Lvelhood and Agrcultural Producton Survey conducted n years 1, 3, and 5 by WFP country offces n each of the 21 P4P plot countres. Dsaggregaton: Dsaggregated by sex of the household member through whch the household was selected for the ntervew. Ths s the household member who s a member of the farmers organzaton through whch the household was selected and whose name was selected from that organzaton s membershp for the ntervew. Schedule/Frequency of Data Collecton: Data to support ths ndcator wll be collected n 2009 (baselne) and agan n years three (2011) and fve (2013) of the P4P plot to support md-term and fnal evaluatons, respectvely. Data lmtatons and Qualty Assessments: Estmates of household ncome obtaned from surveys depend on respondents (who are often poorly educated and rarely keep records) beng able to accurately recall sales and expendtures over a 12 month perod. They may also have ncentves not to respond honestly. Furthermore, data are collected from a random sample so samplng error may also affect the qualty of the estmates. Method/Approach of Collecton/Calculaton: The data to support ths ndcator are collected through structured ntervews wth smallholder farmer households conducted n years 1, 3, and 5 by WFP n plot countres selected for mpact assessment. Households are randomly selected from among the smallholder members of farmers organzatons (those that are partcpatng n P4P and, for a comparson group, those that are not partcpatng n P4P). Sample szes are suffcent to ensure a fve percent margn of error. Household ncome s the sum of net ncome from the sale of staple and cash crops, net ncome from lvestock, and net ncome from other lvelhood actvtes. Net household ncome from the sale of staple and cash crops: A household s net ncome from the sale of staple and cash crops s derved from the data collected n questons B7 through B11. Net ncome s the dfference between recepts from the sale of crops and the expenses assocated wth plantng, tendng, harvestng, and marketng the crops. The followng table shows each recept and cost tem assocated wth crops, the varables n the Farmer Lvelhood and Agrcultural Producton Survey that contrbute data to calculaton of the recept or cost, and the formula for calculatng the value of the recept or cost from the ndcated varables. Purchase for Progress Indcator Reference 2

9 Category Contrbutng varables 1 Calculaton Recepts from sale of crops B11_rf where r = 0 through 9 Seed expenses B7_r where r = 0 through 9 B7_rl where r = 0 through 9 Pestcde expenses B7_rm where r = 0 through 9 Other non-labor expenses B7_rn where r = 0 through 9 Labor (by tme) expenses B7_rq where r = 0 through 9 B7_rs where r = 0 through 9 9 r 0 9 r 0 9 r 0 r r 0 B 11_ rf B 7 _ r B 7 _ rm B 7 _ rn B 7 _ rq Labor (by task) expenses B9 None, use as reported. Fertlzer expenses B10_1d and B10_2d B10 _1d B10_ 2d Value of crops retaned for household consumpton B12_re where r=0 through 9 See next row. 9 r 0 9 r 0 B7 _ rl B7 _ rs, where n ndexes ndvdual members of a partcular farmers organzaton for whch baselne data exst and N s the total number of members of the farmers organzaton for whch baselne data exst. All weght unts (B7_rf and B11rc) are converted to klograms. The formula must be crop specfc and the formula for each crop must account for the possble multple sales of the crop n dfferent season. The average prce (the expresson outsde of the square brackets) must then be weghted by the quanttes sold n each sale. Net household ncome from the sale of lvestock and lvestock products: A household s net ncome from the sale of lvestock and lvestock products s derved from the data collected n queston D2. Net ncome s the dfference between recepts from the sale of lvestock and products and the expenses assocated wth buyng, rearng, and tendng lvestock. The followng table shows each recept and cost tem assocated wth lvestock, the varables n the Farmer Lvelhood and Agrcultural Producton Survey that contrbute data to calculaton of the recept or cost, and the formula for calculatng the value of the recept or cost from the ndcated varables. Category Contrbutng varables Calculaton Recepts from sale of lvestock D2_rf where r = 1 through 9 D2_rg where r = 1 through 9 Recepts from sale of lvestock products D2_r where r = 1 through 9 9 r 1 9 r 1 D 2 _ rf D 2 _ r D2 _ rg D2_rd where r=1 through Expenses of rasng lvestock D2_xj where r = 1 through 9 D 2 _ rd D2 _ rj D2 _ rk D2_xk where r = 1 through 9 r 1 r 1 r 1 Net household ncome from other lvelhood actvtes: A household s net ncome from other lvelhood actvtes s derved from the data collected n queston E1. Net ncome s the dfference between recepts and expenses assocated wth an actvty. The followng table shows each recept and cost tem, the varables n the Farmer Lvelhood and Agrcultural Producton Survey that contrbute data to calculaton of the recept or cost, and the formula for calculatng the value of the recept or cost from the ndcated varables. Category Contrbutng varables Calculaton Purchase for Progress Indcator Reference 3

10 Income from other lvelhood actvtes E1_rc where r = 1 through 10 Expenses of other lvelhood actvtes E1_re where r = 1 through r 1 10 r 1 E 1_ rc E 1_ re Net annual household ncome s the sum of all the recepts mnus the sum of all the expenses descrbed above for crops, lvestock, and other lvelhood actvtes. Average household ncome (over all households) s the arthmetc average or mean of net annual household ncome. Repeat the analyses descrbed above for male and female subsets of the data from both the partcpatng and non-partcpatng groups to dsaggregate the ndcator by sex. Follow the nstructons n Dscountng Monetary Values on page 68 to express the ndcator value n real terms. Follow tne nstructons n Assessng Impact on page 68 to assess the mpact of P4P on average annual household ncomes. Addtonal Comments: Target: The P4P proposal antcpates that partcpaton n P4P wll ncrease average annual household ncomes of partcpatng farmers by $50. Ths s a $50 ncrease n average annual household ncome (from all sources) per year that a household s engaged wth P4P. Therefore, a household that s engaged wth P4P (.e., s a member of a partcpatng farmers organzaton) for fve years would expect to regster an average (over the fve years) ncrease n annual household ncome of $50. Purchase for Progress Indcator Reference 4 For Internal Use Only

11 Logframe Component: Impact Indcator (ncludng precse Unt of Measurement): Number of partcpatng smallholder/low ncome farmer s wth average annual household ncome mprovements of at least $50. Unt: Real household ncome (local currency & USD) Objectve: Not relevant. Ths s an mpact-level ndcator and thus encompasses all four objectves. Logframe Component: Impact To facltate ncreased agrcultural producton and sustaned market engagement and thus ncrease ncomes and lvelhoods for partcpatng smallholder/low ncome farmers, the majorty of whom are women. Indcator Descrpton: Annual real net household ncome (from all sources) of smallholder/low ncome farmers who are members of farmer assocatons partcpatng n P4P. The defnton of smallholder farmer wll vary by country. Partcpaton n P4P means that the smallholder farmer has the opportunty to sell to WFP through P4P and s (probably) recevng supply-sde support because of P4P. Ratonale/Crtcal Assumptons for Indcator: Ratonal/Crtcal Assumptons: Ths ndcator s closely related to the prevous ndcator whch measures annual household ncome from all sources. Ths ndcator establshes a $50 threshold on annual ncome mprovement and represents the defnton of project benefcares as defned n the Bll and Melnda Gates Foundaton proposal. Data Source(s): Farmer Lvelhood and Agrcultural Producton Survey conducted years 1, 3, and 5 by WFP country offces n each of the 21 P4P plot countres. Dsaggregaton: Dsaggregated by country. Schedule/Frequency of Data Collecton: Data to support ths ndcator wll be collected n 2009 (baselne) and agan n years three (2011) and fve (2013) of the P4P plot to support md-term and fnal evaluatons, respectvely. Data lmtatons and Qualty Assessments: Estmates of household ncome obtaned from surveys depend on respondents (who are often poorly educated and rarely keep records) beng able to accurately recall sales and expendtures over a 12 month perod. They may also have ncentves not to respond honestly. Furthermore, data are collected from a random sample so samplng error may also affect the qualty of the estmates. Method/Approach of Collecton/Calculaton: The data to support ths ndcator are collected through structured ntervews wth smallholder farmer households conducted by WFP n years 1, 3, and 5 n plot countres selected for mpact assessment. Households are randomly selected from among the smallholder members of farmers organzatons (those that are partcpatng n P4P and, for a comparson group, those that are not partcpatng n P4P). Sample szes are suffcent to ensure a fve percent margn of error. The value of the ndcator for a country s the number of ndvdual partcpatng households for whom:, where y represents annual household ncome, a bar over y ndcates average (over all households ) annual household ncome and the subscrpts p, c, n, and 0 denote, respectvely, P4P, non-p4p, year n of the P4P plot, and the baselne year. See prevous ndcator for a methods for calculatng annual household ncome (y). Addtonal Comments: Target: The P4P proposal antcpates that partcpaton n P4P wll ncrease average annual household ncomes of partcpatng farmers by $50. Ths s a $50 ncrease n average annual household ncome (from all sources) per year that a household s engaged wth P4P. Therefore, a household that s engaged wth P4P (.e., s a member of a partcpatng farmers organzaton) for fve years would expect to regster an average (over the fve years) ncrease n annual household ncome of $50. Purchase for Progress Indcator Reference 5

12 Logframe Component: Outcome 1.1 Indcator (ncludng precse Unt of Measurement): Number of completed complatons (by WFP) of best practce programmng and polcy recommendatons from P4P. Unt: Reports Objectve: Objectve 1. To dentfy and share best practces for WFP, NGOs, governments, and agrcultural market stakeholders to ncrease proftable smallholder/low ncome farmer engagement n markets. Logframe Component: Outcome 1.1: WFP and other agrcultural development stakeholders collaborate to dentfy procurement and market development best practces from P4P experence. Indcator Descrpton: Ths ndcator refers to reports prepared by WFP that document the key best practce programmng and polcy recommendatons resultng from P4P. Ratonale/Crtcal Assumptons for Indcator: Perodc reports summarzng the key best practce programmng and polcy recommendatons are a fundamental part of documentng the lessons derved from P4P and sharng those lessons wdely. Data Source(s): The P4P Unt n Rome wll be responsble for complng and wrtng the reports and wll be the source of data for ths ndcator. Dsaggregaton: None Schedule/Frequency of Data Collecton: Annually to concde wth WFP nternal reportng requrements and reportng requrements to donors. Data lmtatons and Qualty Assessments: None Method/Approach of Collecton/Calculaton: Document revew. The value of the ndcator s the cumulatve number of reports produced. Addtonal Comments: None. Purchase for Progress Indcator Reference 6

13 Logframe Component: Output Indcator (ncludng precse Unt of Measurement): Completed global level M&E system ncludng M&E plan, mplementaton gudelnes, M&E manual, and analyss and reportng routnes/templates. Unt: Reports Objectve: Objectve 1. To dentfy and share best practces for WFP, NGOs, governments, and agrcultural market stakeholders to ncrease proftable smallholder/low ncome farmer engagement n markets. Logframe Component: Output 1.1.1: Mechansms and procedures to collect and manage P4P performance data developed & functonng. Indcator Descrpton: A complete M&E system to gude the global-level programme ncludes, at a mnmum, the followng elements. A baselne data collecton report ncludng an mpact assessment model; a samplng strategy; baselne data collecton nstruments for farmers organzatons, smallholder farmers, and traders; enumerator tranng materals, and a data collecton manual. A montorng system report for P4P contanng a global logframe; ndcator worksheets; a data collecton plan; a data analyss plan; a data reportng plan; montorng data collecton nstruments for farmers organzatons, smallholder farmers, and traders; and enumerator tranng materals. A montorng system report for LRP contanng a data collecton plan; a data analyss plan; and a data reportng plan. Ratonale/Crtcal Assumptons for Indcator: An M&E system s crucal to support learnng, evaluaton, and performance montorng n P4P. Data Source(s): The P4P Unt n Rome wll create and document the M&E system and wll be the source of data for ths ndcator. Dsaggregaton: None Schedule/Frequency of Data Collecton: Annually to concde wth WFP nternal reportng requrements and reportng requrements to donors. Data lmtatons and Qualty Assessments: None. Method/Approach of Collecton/Calculaton: Document revew. The value of the ndcator s no before the M&E system s complete and yes afterward. Addtonal Comments: None. Purchase for Progress Indcator Reference 7

14 Logframe Component: Output Indcator (ncludng precse Unt of Measurement): Number of P4P plot countres mplementng M&E system (e.g., collectng data, producng requred reports, etc.). Unt: WFP Country Offce P4P Unts Objectve: Objectve 1. To dentfy and share best practces for WFP, NGOs, governments, and agrcultural market stakeholders to ncrease proftable smallholder/low ncome farmer engagement n markets. Logframe Component: Output 1.1.1: Mechansms and procedures to collect and manage P4P performance data developed & functonng. Indcator Descrpton: The number of P4P plot countres that are on schedule wth mplementng the P4P M&E system. On schedule n mplementng means that they are collectng the requred data on schedule, conductng the requred analyses, and producng and delverng the requred reports to the P4P Unt n Rome as scheduled. Requred elements of mplementng the M&E system nclude: Quarterly reports (sent to P4P Reports Offcer), Annual M&E reports, Farmers organzaton, smallholder farmer, and trader surveys (annually), Case studes (quarterly or b-annually per country offce schedule), Annual analyses of survey data and reportng of results, Procurement data from WFP s PASTFood tool, Market nformaton, and Partner M&E data (ncludes data on producton, productvty, yelds, producton costs, tranng actvtes, etc.) Ratonale/Crtcal Assumptons for Indcator (ncludng both P4P and LRP purchases): The WFP country offces n the 21 P4P plot countres are responsble for collectng much of the data to support the global P4P M&E system. Falure of the country offces to mplement ther M&E systems n a standardzed and tmely manner (.e., collectng and analyzng data and reportng quanttatve and qualtatve results) wll severely compromse the ablty of the global M&E system to draw lessons from P4P and acheve ts learnng objectves. Data Source(s): The P4P Unt n Rome wll montor and document country-level Dsaggregaton: None. mplementaton of the M&E system. It wll serve as the repostory for the mplementaton reports, data, and reports on data analyses that wll provde the data for ths ndcator. Schedule/Frequency of Data Collecton: Annually to concde wth WFP nternal reportng requrements and reportng requrements to donors. Data lmtatons and Qualty Assessments: None. Method/Approach of Collecton/Calculaton: Revew of P4P Unt M&E mplementaton records. The value of the ndcator s the number of P4P plot countres that are on schedule wth mplementng all of the elements of ther P4P M&E systems. Addtonal Comments: Country offces need to carefully document secondary data sources ncludng an assessment of ther qualty and lmtatons. Purchase for Progress Indcator Reference 8

15 Logframe Component: Output Indcator (ncludng precse Unt of Measurement): Percentage of requred M&E reports delvered to, or developed by, P4P Unt. Unt: Percentage of requred reports Objectve: Objectve 1. To dentfy and share best practces for WFP, NGOs, governments, and agrcultural market stakeholders to ncrease proftable smallholder/low ncome farmer engagement n markets. Logframe Component: Output 1.1.2: Montorng and evaluaton results compled, analyzed, and dssemnated. Indcator Descrpton: M&E reports requred of the country offces nclude quarterly reports, annual reports, and an annual montorng report. Requred M&E reports for the P4P Unt n Rome nclude annual M&E report to WFP, annual M&E report to donors, Techncal Revew Panel report, annual country and global revews, WFP Executve Board report, and reportng to nternal and other stakeholders. The ndcator s cumulatve from year to year. Ratonale/Crtcal Assumptons for Indcator: Reportng s a vtal functon of an M&E system and crtcal to achevng the learnng and sharng objectves of P4P. The ndcator measures the extent to whch requred reports are beng generated. Data Source(s): The P4P Unt n Rome wll admnster the M&E system and serve as the repostory for all reports. It s therefore the source of data for ths ndcator. Schedule/Frequency of Data Collecton: Annually to concde wth WFP nternal reportng requrements and reportng requrements to donors. Dsaggregaton: The ndcator s dsaggregated by country (.e., Afghanstan, Burkna Faso, El Salvador, Ethopa, Ghana, Guatemala, Honduras, Kenya, Malaw, Mal, Mozambque, Ncaragua, Sudan, Tanzana, Uganda, Zamba, Democratc Republc of Congo, Lbera, Rwanda, Serra Leone, and Laos) and the P4P Unt n Rome. Also dsaggregated by report type (quarterly and annual reports (COs), annual montorng/evaluaton/data collecton reports (COs), annual M&E report to WFP (HQ), annual M&E report to donors (HQ), Techncal Revew Panel report (HQ), annual country and global revews (HQ), WFP Executve Board report (HQ), and report to nternal and other stakeholders (HQ). Data lmtatons and Qualty Assessments: None. Method/Approach of Collecton/Calculaton: Revew of P4P Unt M&E mplementaton records and documents. The value of the ndcator s the cumulatve number of requred reports completed. Addtonal Comments: None. Purchase for Progress Indcator Reference 9

16 Logframe Component: Output Indcator (ncludng precse Unt of Measurement): Average percentage of nvted/expected organzatons represented at event/meetng. Unt: Percentage of nvtatons accepted Objectve: Objectve 1. To dentfy and share best practces for WFP, NGOs, governments, and agrcultural market stakeholders to ncrease proftable smallholder/low ncome farmer engagement n markets. Logframe Component: Output 1.1.3: Engagement of agrcultural and market development stakeholders (e.g., governments, NGOs, partners, prvate sector, etc.) n dalogue to nterpret fndngs and valdate best practces facltated Indcator Descrpton: Average annual (over all applcable meetngs or events) percentage of nvted agrcultural development stakeholders who attend. Invted stakeholders nclude the external stakeholders nvted or expected to attend a specfc meetng/event. Applcable meetngs/events nclude country level acton revews, regonal P4P meetngs, global events, techncal revew panels, lessons learnt events, and country offce stakeholder meetngs. Ratonale/Crtcal Assumptons for Indcator: Engagng a wde range of agrcultural development stakeholders n ongong dalogue s a vtal part of learnng and sharng n P4P. The two ndcators for Output provde a comprehensve pcture of the level of stakeholder engagement. Ths ndcator measures the degree to whch WFP s able to engage the desred stakeholders n meetngs. The other ndcator for ths output assesses the level of engagement of ndvdual stakeholders over tme. Data Source(s): Meetng/event attendance records or mnutes from both country offces and the P4P Unt n Rome. Dsaggregaton: Dsaggregated by type of event/meetng and by country (.e., Afghanstan, Burkna Faso, El Salvador, Ethopa, Ghana, Guatemala, Honduras, Kenya, Malaw, Mal, Mozambque, Ncaragua, Sudan, Tanzana, Uganda, Zamba, Democratc Republc of Congo, Lbera, Rwanda, Serra Leone, and Laos). Schedule/Frequency of Data Collecton: Annually to concde wth WFP nternal reportng requrements and reportng requrements to donors. Data lmtatons and Qualty Assessments: The qualty of ths ndcator wll depend on how well country offces and the P4P Unt n Rome track nvtatons and attendance at the specfed meetngs/events. Method/Approach of Collecton/Calculaton: Revew of meetng/event nvtaton and attendance records. The ndcator value s the total number of nvtatons to the specfed meetngs/events that were accepted (.e., acted upon) dvded by the total number of nvtatons (to organzatons or ther representatves) made to the specfed meetngs/events. The ndcator s cumulatve over the fve-year P4P plot. The unt of measure s nvtatons accepted, not organzatons or ndvduals. Therefore n the case where an ndvdual or organzaton s nvted to multple meetngs/events, each nvtaton and nvtaton acceptance s ncluded when calculatng the ndcator. Addtonal Comments: Country offces and the P4P Unt n Rome wll need to keep track of nvtatons and attendance at all meetngs and events. Purchase for Progress Indcator Reference 10

17 Logframe Component: Outcome 1.2 Indcator (ncludng precse Unt of Measurement): Number of partcpatng stakeholders that have ncorporated best procurement and market development recommendatons nto ther operatons, procedures, or polcy documents. Unt: Stakeholders Objectve: Objectve 1. To dentfy and share best practces for WFP, NGOs, governments, and agrcultural market stakeholders to ncrease proftable smallholder/low ncome farmer engagement n markets. Logframe Component: Outcome 1.2: By the end of the project, agrcultural development stakeholders (e.g., governments, NGOs, prvate sector, donors, etc.) have ntegrated smallholder/low ncome farmer-focused market development and procurement best practces nto ther operatons, procedures, or polces Indcator Descrpton: Number of agrcultural development stakeholders that have ncorporated best procurement or market development recommendatons. The applcable recommendatons are those explctly documented n P4P materals. Incorporated means offcally ncorporatng the recommendatons by endorsng them, or wrtng them nto offcal procedure or polcy documents. Ratonale/Crtcal Assumptons for Indcator: The wder (beyond WFP) success of P4P depends on other agrcultural development stakeholders adoptng the resultng best procurement and market development recommendatons and ncorporatng them nto ther operatons, procedures, and polces. Data Source(s): Offcal documents of agrcultural development stakeholders wll provde the documented evdence for ths ndcator. WFP headquarters or country-offce staff may have personal knowledge of stakeholders ncorporatng recommendatons and should back up ths knowledge wth a revew of documents. Schedule/Frequency of Data Collecton: Annually to concde wth WFP nternal reportng requrements and reportng requrements to donors. Dsaggregaton: None. Data lmtatons and Qualty Assessments: Ths s a dffcult ndcator to measure precsely. It s lkely that WFP wll mss some nstances of a recommendaton beng ncorporated nto operatons, procedures, or polces of external organzatons. Method/Approach of Collecton/Calculaton: Document revew. Document wrtten evdence that a stakeholder has ncorporated a specfc recommendaton arsng from the P4P plot nto ts operatons, procedures, or polcy documents. The ndcator s cumulatve over the fve-year P4P plot. The unt of measure s stakeholders, not procurement and market development practces. Therefore, f a gven stakeholder ncorporates multple recommendatons, t counts only once aganst the value of ths ndcator. Country offces wll have to report stakeholders by name to accommodate aggregaton across countres. In the case where a stakeholder has a presence n more than one P4P plot country and t establshes operatons, procedure, and polcy gudelnes unformly across all countres, t should be counted only once when aggregatng the ndcator value across countres. If a stakeholder has a presence n multple P4P plot countres but the country unts operate ndependently (.e., set ther own, country-specfc operatons, procedure, and polcy gudelnes), then they should be treated as separate stakeholders for ths ndcator. Addtonal Comments: None. Purchase for Progress Indcator Reference 11

18 Logframe Component: Output Indcator (ncludng precse Unt of Measurement): Number of publcatons, or other communcatons, produced by WFP that contan specfc programmng or polcy recommendatons (e.g., gudance to country offces, poston papers, polcy recommendatons, etc.) Unt: Publcatons/communcatons Objectve: Objectve 1. To dentfy and share best practces for WFP, NGOs, governments, and agrcultural market stakeholders to ncrease proftable smallholder/low ncome farmer engagement n markets. Logframe Component: Output 1.2.1: Implcatons of lessons learned and best practces for programmng or polcy (ncludng specfc recommendatons) documented and conveyed to agrcultural market stakeholders and others. Indcator Descrpton: Number of tmes WFP has publshed/communcated specfc programmng or polcy recommendatons arsng from P4P. The applcable recommendatons are those explctly documented n P4P materals. Applcable publcatons/communcatons nclude publcatons, presentatons, audovsual materal, gudance notes, and occasonal papers. Ratonale/Crtcal Assumptons for Indcator: Communcatng the lessons and recommendatons from P4P, both wthn WFP and to other agrcultural development stakeholders, s a fundamental method of sharng best practces dentfed durng P4P. Data Source(s): Documents and other communcatons. Dsaggregaton: None. Schedule/Frequency of Data Collecton: Annually to concde wth WFP nternal reportng requrements and reportng requrements to donors. Data lmtatons and Qualty Assessments: None. Method/Approach of Collecton/Calculaton: Revew of documents and other communcatons by the P4P Unt n Rome. The value of the ndcator s the cumulatve (over the fve-year P4P plot) number of publcatons, or other communcatons. Addtonal Comments: None. Purchase for Progress Indcator Reference 12

19 Logframe Component: Output Indcator (ncludng precse Unt of Measurement): Number of meetngs of agrcultural development stakeholders at whch ether polcy or programmng proposals are tabled by P4P mplementers. Unt: Number of meetngs Objectve: To dentfy and share best practces for WFP, NGOs, governments, and agrcultural market stakeholders to ncrease proftable smallholder/low ncome farmer engagement n markets. Logframe Component: Output 1.2.1: Implcatons of lessons learned and best practces for programmng or polcy (ncludng specfc recommendatons) documented and conveyed to agrcultural market stakeholders and others. Indcator Descrpton: Meetngs nclude any meetng of P4P stakeholder. Polcy or programmng proposals nclude any formal proposal relevant to programmng or polcy made by P4P mplementers (.e., WFP country offces or P4P Unt n Rome) that requres acton by the stakeholder (e.g., votng to approve, endorse, or act on the proposal). Ratonale/Crtcal Assumptons for Indcator: Dssemnatng dentfed best procurement and market development practces to agrcultural development stakeholders and encouragng those stakeholders to ncorporate those practces (when applcable) nto ther programmng and polces s a crucal part of puttng the lessons of P4P nto practce beyond WFP. Data Source(s): Meetng mnutes or other records of meetng actvty, P4P mplementaton records. Dsaggregaton: None. Schedule/Frequency of Data Collecton: Bannually to concde wth WFP nternal reportng requrements and reportng requrements to the donor (the Bll and Melnda Gates Foundaton). Data lmtatons and Qualty Assessments: WFP Country Offces and the P4P Unt n Rome wll have to carefully document the number of tmes they table polcy or programmng proposals at meetngs of agrcultural development stakeholders. Method/Approach of Collecton/Calculaton: WFP Country Offces and the P4P Unt n Rome wll document nstances when they table programmng or polcy proposals at stakeholder meetngs. The ndcator s cumulatve over the fve-year P4P plot. Addtonal Comments: None. Purchase for Progress Indcator Reference 13

20 Logframe Component: Outcome 2.1 Indcator (ncludng precse Unt of Measurement): Average per farm marketable surplus of staple commodtes produced by smallholder members of partcpatng farmers organzatons. Unt: Klogrammes Objectve: Objectve 2. To ncrease smallholder/low ncome farmers' capactes for agrcultural producton and market engagement n order to rase ther ncome from agrcultural markets. Logframe Component: Outcome 2.1: By the end of the project, partcpatng smallholder/low ncome farmers have ncreased ther marketable surpluses of staple commodtes. Indcator Descrpton: The ndcator measures the average (.e., arthmetc mean across farms) marketable surplus of staple commodtes. Marketable surplus s the dfference between the quantty a smallholder farmer produces and the quantty needed for household consumpton (.e., consumpton, seed, anmal feed, allowance for post harvest loss). Staple commodtes are country-specfc but generally nclude those that are storable for a year or more and form the bass of a tradtonal det. Each country wll defne ts own set of staple commodtes. Partcpatng farmers organzatons are those that have an opportunty to sell to WFP through P4P. The defnton of smallholder farmer s country-specfc. Ratonale/Crtcal Assumptons for Indcator: Increased producton of surpluses (.e., above household need) staple commodtes s one of the key pathways to ncreased ncomes for smallholder farmers under P4P. It s crtcal that the M&E system determne whether P4P s affectng producton or not. Data Source(s): Farmer Lvelhood and Agrcultural Producton Survey conducted n years 1, 3, and 5 by WFP country offces n each of the 21 P4P plot countres. Schedule/Frequency of Data Collecton: Years 1, 3, and 5.Tmng vares by country based on tmng of agrcultural harvestng and marketng seasons. Dsaggregaton: Dsaggregated by staple commodty and by the sex of the household member through whch the household was selected for the ntervew. Ths s the household member who s a member of the farmers organzaton through whch the household was selected and whose name was selected from that organzaton s membershp for the ntervew. The ndcator may also be dsaggregated by sex of the head of the household. Data lmtatons and Qualty Assessments: It s dffcult to accurately estmate agrcultural producton and the estmates wll be subject to some amount of measurement error. Estmates are also based on a sample of farmers and may also be subject to samplng error. Method/Approach of Collecton/Calculaton: Structured ntervews wth random sample of smallholder farmers from two comparson groups one partcpatng n P4P and the other not partcpatng provde the data for ths ndcator. The components of marketable surplus are (by crop) quantty produced, quantty needed for household consumpton, quantty needed for seed and anmal feed, and quantty lost to spolage or pests. These components, the questons from the Farmer Lvelhood and Agrcultural Producton Survey that contrbute to the component, and nstructons for calculatng each component are: Measure Contrbutng questons Calculaton Agrcultural producton (by crop) B7_0e through B7_9e B7_0f through B7_9f B7_0g through B7_9g Use responses to columns e, f, and g of queston B7 to calculate total producton for each crop n klogrammes. Create a new varable that s the weght n klogrammes of each response to column f of queston B7. When the response to column f of queston B7 s other, then the value of the new varable should be the number n column g of queston B7. Total producton, n klogrammes, for crop s then: q B7 _ e nv1 where nv1 s the value of the new varable for crop. Purchase for Progress Indcator Reference 14

21 Quantty needed for household consumpton (by crop) Quantty needed for seed, anmal feed, or lost to spolage or pests (by crop) C2_1c through C2_5c C2_1d through C2_5d C2_1e through C2_5e B12_1d through B12_5d B12_1f through B12_5f Use the responses to columns c, d, and e of queston C2 to calculate the quantty (n klogrammes) of each crop needed for household consumpton. Create a new varable that s the weght n klogrammes of each response to column d of queston C2. When the response to column d of queston C2 s other, then the value of the new varable should be the number n column e of queston C2. Total household consumpton needs, n klogrammes, for crop s then: hc C2 _ c nv2 where nv2 s the value of the new varable for crop. Determne the quantty (n klogrammes) of each crop needed for seed, feed, and loss. Create a new varable that s the sum of columns d and f of queston B12. Dvde the new varable by 100. The quantty of crop (n klogrammes) needed for seed, feed, and loss s then: where nv3 s the new varable and q s the total producton of crop from above. sfl q nv3 Marketable surplus for crop s then: ms q c sfl where the varables are defned above. Aggregate (over all crops) marketable surplus s: ms ms where denotes crops. Make sure when calculatng marketable surpluses that the varables q, c, and sfl all refer to the same crops. The order of the crops n the rows of tables B7, B12, and C2 may be dfferent. The average (mean) marketable surplus s the average (over all farms) marketable surplus produced. Calculate the average for each crop by dvdng ms by the total number of farms that produced crop. Calculate the average surplus over all crops by dvdng ms by the total number of respondng farms. Calculate separate measures of marketable surplus for households where the member selected for the ntervew s male and households where the member selected for the ntervew s female and an aggregate (over sex) measure. The ndcator may also be dsaggregated by sex of the household head. Follow tne nstructons n Assessng Impact on page 68 to assess the mpact of P4P on per farm marketable surplus of staple commodtes produced by smallholder farmers. Addtonal Comments: Ths ndcator s an mpact ndcator n the sense that the data exst to calculate the mpact of P4P on the average quantty of marketable surpluses produced. The average mpact of P4P on the quantty of marketable surpluses produced s the dfference between average marketable surplus for the P4P group of smallholder farmers and average marketable surplus for the non-p4p group of smallholder farmers. The mpact can also be dsaggregated by crop and sex. It s of partcular nterest to examne changes n surpluses produced by male and female ntervew subjects (.e., sex of those selected for the ntervew) by commodty and trends n the producton of surpluses over tme. Purchase for Progress Indcator Reference 15

22 Logframe Component: Outcome 2.1 Indcator (ncludng precse Unt of Measurement): Average per farm quantty of staple commodtes sold by partcpatng smallholder/low ncome farmers. Unt: Klogrammes Objectve: Objectve 2. To ncrease smallholder/low ncome farmers' capactes for agrcultural producton and market engagement n order to rase ther ncome from agrcultural markets. Logframe Component: Outcome 2.1: By the end of the project, partcpatng smallholder/low ncome farmers have ncreased ther marketable surpluses of staple commodtes. Indcator Descrpton: Average (per farm) sales (to all buyers) n klograms of staple commodtes. Staple commodtes are country-specfc but generally nclude those that are storable for a year or more and form the bass of a tradtonal det. Each country wll defne ts own set of staple commodtes. The defnton of smallholder farmer s country-specfc. Ratonale/Crtcal Assumptons for Indcator: To ncrease ther ncomes, smallholder farmer not only have to produce greater surpluses, they also have to sell them. Ths ndcator measures smallholder farmers total sales (to all sources) of staple commodtes. It does not attempt to determne whether farmers are sellng from what they need for household consumpton. Data Source(s): Farmer Lvelhood and Agrcultural Producton Survey conducted n years 1, 3, and 5 by WFP country offces n each of the 21 P4P plot countres. Schedule/Frequency of Data Collecton: Years 1, 3, and 5. Tmng vares by country based on tmng of agrcultural harvestng and marketng seasons. Dsaggregaton: Dsaggregated by sex of the household member through whch the household was selected for the ntervew. Ths s the household member who s a member of the farmers organzaton through whch the household was selected and whose name was selected from that organzaton s membershp for the ntervew. May also be dsaggregated by sex of the head of the household. Data lmtatons and Qualty Assessments: It s dffcult to accurately estmate sales of agrcultural products and the estmates wll be subject to some amount of measurement error. Estmates are also based on a sample of farmers and may also be subject to samplng error. Method/Approach of Collecton/Calculaton: Ths ndcator ncludes only WFP food basket commodtes. Structured ntervews wth random samples of smallholder farmers from two comparson groups one partcpatng n P4P and the other not partcpatng provde the data for ths ndcator. Sales of each staple commodty,, are determned by multplyng the quantty harvested by the proporton reported sold or planned for sale. These components, the questons from the Farmer Lvelhood and Agrcultural Producton Survey that provde the data to calculate each component, and nstructons for calculatng each component are: Measure Contrbutng questons Calculaton Agrcultural producton (by crop) Quantty sold or planned for sale (by crop) B7_0e through B7_9e B7_0f through B7_9f B7_0g through B7_9g B12_1b through B12_5b B12_1c through B12_5c Use responses to columns e, f, and g of queston B7 to calculate total producton for each crop n klogrammes. Create a new varable that s the weght n klogrammes of each response to column f of queston B7. When the response to column f of queston B7 s other, then the value of the new varable should be the number n column g of queston B7. Total producton, n klogrammes, for crop s then: q B7 _ e nv1 where nv1 s the value of the new varable for crop. Determne the quantty (n klogrammes) of each crop sold or planned to be sold. Create a new varable that s the sum of columns b and c of queston B12. Dvde the new varable by 100. The quantty of crop (n klogrammes) sold or planned to be sold s then: nv2 s the new varable and q s the total producton of crop from above. sales q nv 2 where Purchase for Progress Indcator Reference 16

23 The average per farm quantty of commodty sold s then: ndcator f sales N f f, where ndcator s average (per farm) sales of crop, sales f s sales of crop by farm f, and N f s the total number of farms n the sample (consderng only those wth vald data to calculate the ndcator value). The average per farm sales of all staple commodtes s: f ndcator. N sales f Follow tne nstructons n Assessng Impact on page 68 to assess the mpact of P4P on per farm marketable quantty of staple commodtes sold by smallholder farmers. Addtonal Comments: Ths ndcator s an mpact ndcator n the sense that the data exst to calculate the mpact of P4P on the average per farm quantty of staple commodtes sold. The average mpact of P4P on the quantty of staple commodtes sold s the dfference between average quantty sold for the P4P group of smallholder farmers and average quantty sold for the non-p4p group of smallholder farmers. The mpact can also be dsaggregated by crop and sex. Purchase for Progress Indcator Reference 17

24 Logframe Component: Outcome 2.1 Indcator (ncludng precse Unt of Measurement): Average (per smallholder farm) post-harvest losses of staple commodtes as a percentage of annual producton. Unt: Percentage of quantty n klogrammes Objectve: Objectve 2. To ncrease smallholder/low ncome farmers' capactes for agrcultural producton and market engagement n order to rase ther ncome from agrcultural markets. Logframe Component: Outcome 2.1: By the end of the project, partcpatng smallholder/low ncome farmers have ncreased ther marketable surpluses of staple commodtes. Indcator Descrpton: Average (per farm) annual losses of staple commodtes to spolage, anmals, or pests because of poor post-harvest handng or nadequate storage. Staple commodtes are country-specfc but generally nclude those that are storable for a year or more and form the bass of a tradtonal det. Each country wll defne ts own set of staple commodtes. The defnton of smallholder farmer s country-specfc. Ratonale/Crtcal Assumptons for Indcator: Post-harvest losses are hgh n many countres n whch WFP buys. Hgh post-harvest losses threaten households food securty and also lmt the quantty avalable for sale, thereby reducng potental household ncome. Data Source(s): Farmer Lvelhood and Agrcultural Producton Survey conducted n years 1, 3, and 5 by WFP country offces n each of the 21 P4P plot countres. Schedule/Frequency of Data Collecton: Years 1, 3, and 5. Tmng vares by country based on tmng of agrcultural harvestng and marketng seasons. Dsaggregaton: Dsaggregated by commodty and the sex of the household member through whch the household was selected for the ntervew. Ths s the household member who s a member of the farmers organzaton through whch the household was selected and whose name was selected from that organzaton s membershp for the ntervew. May also be dsaggregated by sex of the head of the household. It may also be useful to report ths ndcator for WFP food basket commodtes only. Data lmtatons and Qualty Assessments: It s dffcult for survey respondents to determne post-harvest losses accurately. Most have no records and recall may be naccurate. In addton, the data are collected from a random sample of farmers so samplng error may also be an ssue n data qualty. Method/Approach of Collecton/Calculaton: Structured ntervews wth random samples of smallholder farmers from two comparson groups one partcpatng n P4P and the other not partcpatng provde the data for ths ndcator. Queston B12_d collects the ndcator value drectly for crop. The value of the ndcator for crop s then: ndcator f B12 _ d N f f, where f ndexes farmer households (survey respondents), B12_d h s the row of column B12_d that contans data for crop and household f, and N f s the total number of households wth data for the ndcator. Follow tne nstructons n Assessng Impact on page 68 to assess the mpact of P4P on post-harvest losses of staple commodtes. Addtonal Comments: Ths ndcator s an mpact ndcator n the sense that the data exst to calculate the mpact of P4P on post-harvest losses of staple commodtes. The average mpact of P4P on post-harvest loss percentage s the dfference between post-harvest losses for the P4P group of smallholder farmers and post-harvest losses for the non-p4p group of smallholder farmers. The mpact can also be dsaggregated by crop and sex. Purchase for Progress Indcator Reference 18