MOBIGROW/SEPTEMBER 2017/ PROVISION OF CONSULTNCY SERVICES TO CONDUCT A RIGOROUS IMPACT EVALUATION OF THE KCB MOBIGROW PROGRAM IN KENYA AND RWANDA

Size: px
Start display at page:

Download "MOBIGROW/SEPTEMBER 2017/ PROVISION OF CONSULTNCY SERVICES TO CONDUCT A RIGOROUS IMPACT EVALUATION OF THE KCB MOBIGROW PROGRAM IN KENYA AND RWANDA"

Transcription

1 MOBIGROW/SEPTEMBER 2017/ PROVISION OF CONSULTNCY SERVICES TO CONDUCT A RIGOROUS IMPACT EVALUATION OF THE KCB MOBIGROW PROGRAM IN KENYA AND RWANDA The RFP Clarification Template Item Section/ Paragraph (2) Question as submitted by Response to Clarifications by KCB bidder Financial proposals Does KCB have a budget ceiling Yes, we have a budget ceiling, but kindly give will be evaluated on the basis for this project? us your best. of cost, lead-time and payment terms if not specified in this document xi CVs of Senior Staff Is this only for staff working on the project or all senior staff/c-suite staff? xii Organogram/Organization Chart NB : KCB SHALL ONLY MAKE PAYMENTS THROUGH A KCB ACCOUNT AND THUS ALL BIDDERS ARE ENCOURAGED TO OPEN AN ACCOUNT & Paragraph 2&3/ 2.5 all Program Coverage and Status of Implementation Will Program Coverage and Status of Implementation Is this for the consultant organization or just for the proposed project team? Is it expected that the bidder will have an account with KCB at the time of proposal submission? Is the evaluation to focus only on the second component of the program? Will KCB provide a list of farmers who have been recruited into the program or otherwise assist with identifying eligible participants in the impact evaluation? At the time of the baseline surveys, approximately how many of the Key Staff who will be working on the project ( Principal Investigators) For the consultant organization A KCB account is not a requirement at the time of bidding. However, this will be discussed with the successful Bidder The evaluation will focus on the two components of the program as outlined in 2.2. Yes, KCB will provide the list of farmers and any other support within the organizations means to achieve the objectives of the impact evaluation. As explained in 2.4 of the RFP, the process of recruiting and signing FPOs is ongoing in the

2 8 2.5 Proposed Data Collection Surveys and Timeline Proposed Data Collection Surveys and Timeline Purpose of the Consultancy: Proposed Data Collection Surveys and Timelines Purpose of the Consultancy: Proposed Data targeted farmers in Kenya and Rwanda are expected to have received or be enrolled in training under Component 1 of the program? Does the suggested timeframe incorporate ramp up and reporting? Does both financial and technical proposal include activities? Does KCB anticipate the bidder to disseminate results to a larger audience, maybe through organizing a conference in both countries? When is an award expected on the bid? The table on Page 12 of the RFP could be read as requiring up to eleven surveys if the rows that specify dates are counted. How many total surveys are included in the scope of the impact evaluation for both Rwanda and Kenya? There are four value chains listed in the table on Page 12 of the RFP, two for Kenya and two for Rwanda, two countries. In Kenya, we expect to have over 100,000 dairy farmers in the program while in Rwanda we expect a total of 30,000-50,000 farmers into the program. Yes it does. Yes, it should outline activities for each year and budget KCB will be organizing annual stakeholder events where we will be inviting the bidders to present findings. It s an urgent requirement which KCB intends to fast track and award in the next 2 months. 2.5 outlines what KCB expects, however it also stated that The following table illustrates KCB s expected number of data collection surveys and timelines, even though firms are also encouraged to propose other alternatives in line with the objectives of the evaluation. This means the proposed is not cast on stone and firms are encouraged to apply their expertise and provide alternative depending their proposed methodology. In Kenya, the plan is to target pastoralist s value chain while in Rwanda, the target is crop and dairy value chains. For those bidding for

3 Collection Surveys and Timelines 2.7 Scope of Work, Page 13: In Kenya the impact evaluation will target the pastoralists value chain while in Rwanda, the target will be the crop/dairy value chain Purpose of the Consultancy: Bidding firms should consider nonexperimental methods, or a mix 13 Section 2: Terms of reference/ 2.5 Propose of the consultancy/ Paragraph 2 but two value chains are mentioned on Page 13. Which value chains are included in the scope of the impact evaluation? A randomized control trial would require the random selection of farmers to participate in MobiGrow, and others to not participate in MobiGrow. Does the MobiGrow program intend to (temporarily) exclude randomly selected farmers for the purpose of impact measurement, or will all farmers have an equal opportunity to adopt the online system? The TOR states that Bidding firms should consider non-experimental methods, or a mix when preparing their proposals We would therefore like to seek clarification on whether the proposal is calling for the use of traditional non-experimental impact evaluation techniques, such as Instrumental Variables (IV) and/or propensity score matching (PSM), or whether nonexperimental methods is referring to the use of qualitative evaluation approaches? pastoralists, we expect to have recruited more than 100,000 pastoralists by the time we commence the assignment. See response below, KCB is discouraging RCT as much as possible. However, where a control group is required, KCB will discuss the criteria with the winning firm. The proposal is calling for use of traditional non-experimental impact evaluation techniques, such as Instrumental Variables (IV, difference-in-differences, instrumental variables, regression discontinuity or propensity score matching. Note that KCB will work with the winning firm to finalize the methodology after contract award during a design workshop

4 Learning Questions Should the answers to the learning questions address both components of the program equally? 15 Section 2: Terms of reference/ 2.8 Eligibility, Selection and Preparation Process / Preparation process/ Bullet point 4 In order to increase the response rates to the surveys as part of the data collection, we want to propose making use of an Interactive Voice Response (IVR) platform, which is particularly effective in reaching a large amount of survey respondents. Based on this, we wanted know whether the survey participants (farmers and pastoralists in Kenya and Rwanda) are likely to have access to mobile phones, and whether KCB has the mobile phone contacts for the farmers, that would enable us to use IVR as part of the surveys? Preparation Process How long does KCB expect the workshop to be? Will the workshop need to include other program stakeholders? 17 Kindly advice on the precise deliverable for the tender. Will it be a Social Impact Assessment or development of an M&E Framework Yes, this is what KCB anticipates. Mobile phone ownership/access is a requirement for participation in the MobiGrow program. We have phone contacts for majority of the farmers already recruited into the program, hence we do not anticipate any challenges with the use of IVR. KCB expects to hold 1 1 /2 days Workshop, however, the winning firm and KCB will review and agree on the period. Three departments are involved in the implementation of the program with people drawn from these departments expected to attend. Once again, the number and workshop logistics will be discussed between the winning firm and KCB. The deliverable is a Rigorous Impact Evaluation using non-experimental impact evaluation techniques, such as, difference-indifferences, Instrumental Variables, Regression Discontinuity or Propensity Score Matching, not an M&E Framework.

5