How to Randomize? Dean Karlan Yale University. povertyactionlab.org
|
|
- Moses Harrington
- 5 years ago
- Views:
Transcription
1 How to Randomize? Dean Karlan Yale University
2 Outline of Today s Lectures This lecture Overview of different ways to randomize Convincing/How to gather support for evaluation Typical Plan
3 Good Evaluation Not just How did we do? Also How should we do it? Key component: Identify implementers questions Answer them Make the research a win-win for operations
4 Different ways to randomize
5 Randomization Designs Lottery design (transparent or not) Phase-in design Encouragement design Multiple treatments Rotation design (e.g., balsakhi case) Note: These are not mutually exclusive.
6 Simple Randomization Think of a clinical trial Take 1000 people and give half of them the drug Can we simply apply this idea to social programs?
7 What are the constraints when we randomize in social situations?
8 Key constraints Cannot interfere significantly with program operations Above clinical trial model rarely fits NGOs Cannot be perceived as unfair Must be politically feasible Must be ethical
9 Limited Resources Many programs have limited resources Many more eligible recipients than resources will allow service for Examples: Training for entrepreneurs or farmers Program for X schools or clinics How to allocate these resources?
10 Lottery design Randomly choose from applicant pool In this design participants are explicitly told that winners and losers will end up with different outcomes Use when there is no good reason to choose among a subset of applicants Lottery is perceived as fair Need not be transparent (credit scoring) Often politically more feasible
11 What are other types of lotteries?
12 Lottery Design Built in and optimizing operations Credit scoring Lottery need not be over individuals Can be over groups Which micro-credit groups? Can be over communities Which villages should we enter? Can be over schools Balsakhi
13 Ethicality and Political Feasibility Transparency often helps, sometimes does not Can we give something to the control sites? Sometimes test A versus B, not A versus nothing.
14 What to do if program has 500 applicants for roughly 500 slots? Or less?
15 A less obvious lottery design One trick: Advertise program and greatly increase applicants Now lottery is feasible Is this ethical? Would it be ethical if we added slots to the program and only gave these to the new applicants? Or desirable from the evaluation point of view?
16 When is a lottery impossible?
17 Where a lottery fails Suppose there are 2000 applicants. Screening of applications/need produces 500 worthy candidates There are 500 slots Lottery infeasible
18 What can be done in this situation?
19 Potential Solutions Screening Rule What are they screening for? What elements are essential? What elements are arbitrary? Example: Training program 2000 candidates 1000 fit criteria such as poor enough to be worthy, qualified enough to take advantage of training 250 chosen of out of the 1000 based on particular attributes NGO willing to allocate remaining 250 by lottery Lesson: Many parts of a selection rule are designed simply to weed out candidates
20 Different kind of randomized design
21 Another point of interaction Programs have lives They have initial stages They expand All these are good points to think about randomization
22 Phase-in Design In this design everyone is told that they will end up with the same outcome but some later than others. Use the fact that the program going to expand Example: In 5 years, 500 schools will be covered. In 5 years, 250 districts will receive land tenure What determines which schools or districts will be covered in which year? Some choices may be based on need, potential impact, etc. Some choices largely arbitrary We can therefore choose who gets program early at random Do this on population about which choices are arbitrary
23 Other designs
24 Encouragement design In this design everyone is immediately eligible to receive the program there is enough funding to cover all of them. However not all of them will necessarily take it up Pick some people at random and encourage them to use program Use non-encouraged as control Ethical? What population is this a treatment effect on?
25 Encouragement What is an encouragement? Something that makes some folks (treatment group) more likely to join than others (control group) Key criteria: Should not itself be a treatment Bad idea: intense entrepreneurship training program, as encouragement for credit Good idea: marketing to some but not everyone; make sure the marketing isn t overly informative Think about who responds to the encouragement. Are they different? Bad idea: party with alcohol
26 Encouragement Design: Why Does this Work? First, an extreme example: perfect takeup of those treated, no takeup of those not treated: Encouraged Treatment Not Encouraged Control Treated 100% 0% Untreated 0% 100% Let treatment (encouraged) earn 1 standard deviation more, and the control (unencouraged) remain unchanged. Note: Same difference exists between the treated and untreated. The impact of the intervention is 1 standard deviation higher income.
27 Encouragement Design: Why Does this Work? Now, add non-takeup in the encouraged group Encouraged Not Encouraged Treatment Control Treated 50% 0% Untreated 50% 100% Now, using same true effect size (1 sd), the average effect for the treatment (encouraged) is 0.5 standard deviations (called Intent to Treat, ITT, effect) Then divide the ITT by the differential proportion treated (0.5): the Treatment on the Treated effect, TOT, is 0.5/0.5 = 1 standard deviation.
28 Encouragement Design: Why Does this Work? Last, add takeup in the not encouraged group Encouraged Not Encouraged Treatment Control Treated 50% 25% Untreated 50% 75% Now, using same true effect size (1 sd), the average effect for the treatment is 0.5 standard deviations more, but the control group now improved by 0.25 standard deviations. The ITT effect is thus the difference: 0.25 standard deviations. Then divide the ITT by the differential proportion treated (0.25): the Treatment on the Treated effect, TOT, is 0.25/0.25 = 1 standard deviation.
29 Multiple Treatments Sometimes you are not sure what intervention to implement You can then randomize different interventions with different (randomly chosen) populations Does this teach us about the benefit of any one intervention? Advantage: win-win for operations, can help answer questions for them, beyond simple impact!
30 Convincing But I already know the answer (Between the lines): But I do not want to risk learning that we do not have impact. Finding the right & willing partner
31 Convincing Practitioners Three critical items: Listen. Find ways to answer their operational questions while doing the research. Know the identity of key players and their perspectives. Culture important Sometimes difficult to disagree in person. Is there true buy-in?
32 Convincing Practitioners Typical specific concerns: Gossip Fairness Cost Human resource policies Length of study Politics Experimenting ethics
33 Convincing Practitioners Typical concerns: Gossip (contamination vs spillovers) Will be discussed in more detail on Day 4. In some settings, contamination is good. If the intervention is about information (e.g., allocation of school resources, school performance information, education on child nutrition or breastfeeding, deworming etc.), then you want gossip. But you want to setup the experiment so that you can measure the total impact on those treated, both directly by you and indirectly by the gossip.
34 Convincing Practitioners Fairness Rare is the case of unlimited resources. Given unlimited resources, fairness is entirely in the framing: Provide everyone a 50% probability of receiving treatment Provide those who show up first a 100% probability of receiving treatment, and those who do not a 0% chance. Randomization allows one to learn more about the ideal participants. If a non-random targeting method is used, one might be making a mistake hence not maximizing impact.
35 Convincing Practitioners Typical concerns: Cost Often cheaper than non-experimental evaluations Certainly cheaper when benefits includes. Which costs more for survey work? Which has more downside risk in terms of yielding imprecise or biased results? Key question is not ex-post versus randomized trial, but evaluation versus no evaluation.» When to evaluate?
36 Convincing Practitioners Typical concerns: Human resource policies HR policies often arise if salary is conditional on performance. Then, if the treatment influences performance, problems arise. Or, the treatment could present an alternative that threatens their job! Kenya: resentment of government teachers, afraid the contract teachers will do well and that they will then lose their job. Microcredit: incentive pay quite typical (interesting in its own right!) Calibrate incentive system so that mean compensation is the same. If employees perceive that the treatment is good (or bad) for them, they may put forth extra effort to see it work (or not). Monitoring employee behavior can provide information on whether this is happening.
37 Convincing Practitioners Typical concerns: Length of study Politics: Not always possible. How to build rural roads and avoid corruption? Monitoring Corruption project (Olken, 2005) Prob of audit from 4% to 100% Theft falls by 8% of expenditures
38 Convincing Practitioners Typical concerns: Experimenting ethics: Wrong to use people as guinea pigs. If you think it works, then it is wrong to not treat everyone. Answers: Why are prescription drugs different? All limited initiatives are in some way an experiment, the difference here is that we are controlling the experiment in order to learn. Limited resources. Allocation has to happen somehow. Why not learn while we are doing it? Produce a public good for future generations.
39 Randomization Timeline The following slides are auxiliary slides to detail the typical timeline of a randomized controlled trial.
40 Randomization Timeline Planning 1. Identify problem and proposed solution 2. Identify key players 3. Identify key operations questions to include in study 4. Design randomization strategy 5. Define data collection plan Pilot Implementation 1. Identify target population (sample frame), and baseline data if applicable 2. Randomize 3. Implement intervention to treatment group 4. Measure outcomes
41 Randomization Timeline: Planning 1. Identify problem and proposed solution Define the problem (which should lead to the key hypotheses) Define the intervention (sometimes already established) Learn key hurdles in design of operations (maybe opportunity to help answer them). 2. Identify key players Top management Field staff Donors
42 Planning 3. Identify key operations questions to include in study Find win-win opportunities for operations How to best market? How to sustain the program? Pricing policy Generating demand through spillovers Types or extent of training?
43 Randomization Timeline: Planning 4. Design randomization strategy (more on this later in this lecture) Basic strategy Sample frame Unit of randomization Stratification
44 Randomization Timeline: Planning 5. Define data collection plan Key point: Baseline data is NOT necessary. It can be nice, but is not necessary. More on this tomorrow
45 Randomization Timeline: Pilot Pilots vary in size & rigor Pilots & qualitative steps are important. (Why?) Sometimes a pilot is the evaluation Other times they are pilots for the evaluation
46 Randomization Timeline: Implementation 1. Identify target individuals or villages and collect baseline information (if applicable) 2. Randomize 3. Implement intervention to treatment group 4. Measure outcomes
47 Randomization Timeline: Implementation 1. Identify target individuals and collect baseline data 2. Randomize Real-time randomization e.g. credit scoring All-at-once randomization All villages known up front Waves Want to learn from one wave to the next Expansion plans not well defined throughout country. One district at a time. 3. Implement intervention to treatment group Internal controls critical nothing worse than doing all this work, but not having control on the field! 4. Measure impact after necessary delay to allow impact to occur Common question: How long should we wait? Operational considerations must be traded off. No one-size-fits-all answer. Want to wait long enough to make sure the impacts materialize.
48 Poverty Action Lab: Translating Research into Action MIT
Randomized Evaluations in Practice: Opportunities and Challenges. Kyle Murphy Policy Manager, J-PAL January 30 th, 2017
Randomized Evaluations in Practice: Opportunities and Challenges Kyle Murphy Policy Manager, J-PAL January 30 th, 2017 Overview Background What is a randomized evaluation? Why randomize? Advantages and
More informationCairo Evaluation Clinic: Thoughts on Randomized Trials. For Evaluation of Development
ECONOMIC GROWTH CENTER YALE UNIVERSITY P.O. Box 208629 New Haven, CT 06520-8269 http://www.econ.yale.edu/~egcenter/ CENTER DISCUSSION PAPER NO. 973 Cairo Evaluation Clinic: Thoughts on Randomized Trials
More informationEconomics Training Series Introductory Course. Project Impact Evaluation Design
Economics Training Series Introductory Course Project Impact Evaluation Design Outline 1. What is project impact evaluation? 2. Methods of project impact evaluation? 3. Operational implications. Project
More informationModule 12 Advanced Evaluation Designs (IEs)
Module 12 Advanced Evaluation Designs (IEs) * Certain slides used with permission from the Abdul Latif Jameel Poverty Action Lab (JPAL) and Center of Evaluation for Global Action (CEGA) 1 Module Objectives
More informationWorkshop II Project Management
Workshop II Project Management UNITAR-HIROSHIMA FELLOWSHIP FOR AFGHANISTAN 2007 Introduction to Project Management 15 17 August 2007, Dehradun, India Presented by: Jobaid Kabir, Ph.D. Fellowship Program
More informationImpact Evaluation. Some Highlights from The Toolkit For The Evaluation of Financial Capability Programs in LMIC
Impact Evaluation Some Highlights from The Toolkit For The Evaluation of Financial Capability Programs in LMIC World Bank Dissemination Workshop, New Delhi March 2013 What is the Toolkit? Russia Trust
More informationImpact Evaluation for Safety Nets
Impact Evaluation for Safety Nets Methods and Applications Patrick Premand (Africa HD) Safety Nets Course, December 2013 This material builds on Gertler, P. J.; Martinez, S., Premand, P., Rawlings, L.
More informationMeasuring Impact Impact Evaluation Methods. Nathan Fiala DIW Berlin March 2014
Measuring Impact Impact Evaluation Methods Nathan Fiala DIW Berlin March 2014 1 Why Evaluate? Refine program design Design new programs Improve program targeting (effectiveness) Identify inefficient programs
More informationInternational Program for Development Evaluation Training (IPDET)
The World Bank Group Carleton University IOB/Ministry of Foreign Affairs, Netherlands International Program for Development Evaluation Training (IPDET) Building Skills to Evaluate Development Interventions
More informationWhat is impact evaluation?
February 1st, 2012 GEM Project Presentation Outline 1 Defining and Measuring Impact 2 3 4 Presentation Outline 1 Defining and Measuring Impact 2 3 4 Did the program change anything? How to measure impact?
More informationWhy and How Should the Government Subsidize Education? February 13, 2008
Why and How Should the Government Subsidize Education? February 13, 2008 Human Capital Model To keep things simple and flexible, lets use the following version of the human capital model 2 periods everyone
More informationThe Goldilocks Challenge: learning to structure a right-fit and effective monitoring and evaluation system
The Goldilocks Challenge: learning to structure a right-fit and effective monitoring and evaluation system Dean Karlan Professor of Economics, Yale University President, Innovations for Poverty Action
More informationFREQUENTLY ASKED QUESTIONS
CLINICAL TRIALS FREQUENTLY ASKED QUESTIONS PARTICIPATING IN A CLINICAL TRIAL What is a clinical trial? Clinical trials are research studies that involve people. Through clinical trials, researchers find
More informationToolkit for Impact Evaluation of Public Credit Guarantee Schemes for SMEs (Preliminary)
Toolkit for Impact Evaluation of Public Credit Guarantee Schemes for SMEs (Preliminary) Madrid June 2, 2017 Pietro Calice Finance & Markets Global Practice World Bank Group Outline of the Presentation
More informationOnline Algorithms and Competitive Analysis. Spring 2018
Online Algorithms and Competitive Analysis CS16: Introduction to Data Structures & Algorithms CS16: Introduction to Data Structures & Algorithms Spring 2018 Outline 1. Motivation 2. The Ski-Rental Problem
More informationACADEMIC CAREERS: SALARY NEGOTIATIONS
ACADEMIC CAREERS: SALARY NEGOTIATIONS You may hear back quite soon if you were the final interview candidate, but as in all things related to the academic job search process, soon is a relative term. Some
More informationEC101 DD/EE Practice Midterm 2 November 6, 2014 Version
EC101 DD/EE Practice Midterm 2 November 6, 2014 Version Name (last, first): Student ID: U Discussion Section: Signature EC101 DD/EE F14 Practice Midterm 2 INSTRUCTIONS (***Read Carefully***): ON YOUR QUESTION
More information8 ways to make your survey useless if you are making any of these mistakes with your surveys, you might as well throw away the data and start all over
8 ways to make your survey useless if you are making any of these mistakes with your surveys, you might as well throw away the data and start all over by Stacey Barr introduction Surveys are one of the
More informationPrice Ceilings and Price
Price Ceilings and Price Floors By: OpenStaxCollege Controversy sometimes surrounds the prices and quantities established by demand and supply, especially for products that are considered necessities.
More informationARE YOUR CUSTOMER SERVICE METRICS TELLING THE TRUTH? Many rank frontline teams unfairly.
ARE YOUR CUSTOMER SERVICE METRICS TELLING THE TRUTH? Many rank frontline teams unfairly. It s frightening how many companies are measuring and managing customer service with inaccurate metrics. Sandy Rogers,
More informationKOICA Executive Education Course in Evaluating Social Programs February 2016 Welcome. Lina Marliani Executive Director J-PAL Southeast Asia
KOICA Executive Education Course in Evaluating Social Programs 22-26 February 2016 Welcome Lina Marliani Executive Director J-PAL Southeast Asia Course Introduction Course Leaders Thomas Chupein John Floretta
More informationDEMAND CURVE AS A CONSTRAINT FOR BUSINESSES
1Demand and rofit Seeking 8 Demand is important for two reasons. First, demand acts as a constraint on what business firms are able to do. In particular, the demand curve forces firms to accept lower sales
More informationEvaluating the use of psychometrics
Evaluating the use of psychometrics It is now readily accepted that the effective use of psychometric instruments can add value to an organisation. When used in selection, in conjunction with a competency
More informationTHE HR GUIDE TO IDENTIFYING HIGH-POTENTIALS
THE HR GUIDE TO IDENTIFYING HIGH-POTENTIALS What makes a high-potential? Quite possibly not what you think. The HR Guide to Identifying High-Potentials 1 If you agree people are your most valuable asset
More informationChapter 12. Sample Surveys. Copyright 2010 Pearson Education, Inc.
Chapter 12 Sample Surveys Copyright 2010 Pearson Education, Inc. Background We have learned ways to display, describe, and summarize data, but have been limited to examining the particular batch of data
More informationWorld Bank Africa Gender Innovation Lab (GIL) Call for Expressions of Interest: About the World Bank Africa Region Gender Innovation Lab (GIL)
World Bank Africa Gender Innovation Lab (GIL) Call for Expressions of Interest: Seeking NGOs, governments, donors, and private sector firms with interventions designed to improve women s land tenure security
More information9/24/2008. Visa-VersaVersa
Chapter 4/5 /Supply Def: ability, willingness and desire to purchase a product at all possible prices. Law: The quantity of products demanded will vary inversely with its price. Schedule Graph is abstract,
More informationThe Knapsack Problem
The Knapsack Problem Main Project in Computer Technology Written by Helge Andersen, Ann Merete Børseth and Jenny Helen Nytun Teaching supervisor Noureddine Bouhmala Bakkenteigen, June 2003 Preface This
More informationA Prize in Every Box. Marc Effron. How To Get More Comfortable with Transparency
A Prize in Every Box Marc Effron How To Get More Comfortable with Transparency A Prize in Every Box by Marc Effron, Talent Strategy Group Many companies still refuse to be transparent with their employees
More informationHow to Transition From Annual Performance Reviews to Real-Time Feedback
How to Transition From Annual Performance Reviews to Real-Time Feedback The annual performance review is changing EMPLOYEES ORGANIZATIONS PERFORMANCE REVIEWS 51% 86% 30% Employees believe that annual performance
More informationMeasuring Impact. Advanced Course, July 6 th, 2011 Rachel Glennerster
Measuring Impact Advanced Course, July 6 th, 2011 Rachel Glennerster Outline Quick overview of the steps for defining good measures: Measuring how not just whether Assessing an outcome measure Data collection
More informationECONOMICS 103. Topic 2: Specialization & Trade
ECONOMICS 103 Topic 2: Specialization & Trade Key concepts: production possibilities, absolute advantage, comparative advantage, trade, gains from trade, economic efficiency. Model: production possibility
More informationManagerial Economics Prof. Trupti Mishra S.J.M School of Management Indian Institute of Technology, Bombay. Lecture -29 Monopoly (Contd )
Managerial Economics Prof. Trupti Mishra S.J.M School of Management Indian Institute of Technology, Bombay Lecture -29 Monopoly (Contd ) In today s session, we will continue our discussion on monopoly.
More informationEnterprise development organizations
The current issue and full text archive of this journal is available at wwwemeraldinsightcom/1746-8809htm Useful principles for adopting a market approach for enterprise Frank Lusby Action for, Arlington,
More informationInnovative Marketing Ideas That Work
INNOVATIVE MARKETING IDEAS THAT WORK Legal Disclaimer: While all attempts have been made to verify information provided in this publication, neither the Author nor the Publisher assumes any responsibility
More informationARBONNE UNIVERSITY. SuccessPlan Basics. BY Donna Johnson. Independent Consultant, Executive National Vice President
SuccessPlan Basics BY Donna Johnson Independent Consultant, Executive National Vice President Hello, I m Donna Johnson, Independent Consultant, Executive National Vice President. This training module will
More informationBY BETYE BAILEY, INTOXIMETERS, INC.
BY BETYE BAILEY, INTOXIMETERS, INC. A DEFENSIBLE BREATH hallenges or objections are going to arise after positive tests, not negative ones. In law enforcement, the most litigated offense in the United
More informationAYT. Centre for Analysis of Youth Transitions. Evaluating the impact of youth programmes. Claire Crawford and Anna Vignoles June 2013
AYT Centre for Analysis of Youth Transitions Evaluating the impact of youth programmes Claire Crawford and Anna Vignoles June 2013 CAYT Repository CAYT is a DfE sponsored research centre Reliable and independently
More informationReading Essentials and Study Guide
Lesson 3 Using Economic Models ESSENTIAL QUESTION In what ways do people cope with the problem of scarcity? Reading HELPDESK Academic Vocabulary mechanism process or means by which something can be accomplished
More informationExternalities and the Environment
Externalities and the Environment What is an Externality? When a person/firm does something that affects the interests of another person or firm without affecting prices. Examples: Traffic/telephone/internet
More informationClinical trials patient-education brochure
Released November 2005 Revised January 2008 Revised March 2012 Revised July 17, 2017 Clinical trials patient-education brochure Roslyn Mannon, MD David Rothstein, MD Maria Luisa Alegre, MD, PhD Giorgio
More informationReading Essentials and Study Guide
Lesson 3 Using Economic Models ESSENTIAL QUESTION In what ways do people cope with the problem of scarcity? Reading HELPDESK Academic Vocabulary mechanism process or means by which something can be accomplished
More informationOperator Development Game Plan. Do you have a Game Plan for each Production Area for developing your Operators?
Assisting organisations to engage and develop their people through on-going Continuous Improvement e tech 7 February 2018 Operator Development Game Plan Do you have a Game Plan for each Production Area
More informationFrom FAOSTAT
PAI 897 Lecture 14 Chapter 14 Client orientation. o Make sure that you address the question that the client has posed. Resist temptation to answer question that you find more interesting Resist temptation
More informationA CLIENT S GUIDE WHERE TO START WHAT HAPPENS ON SITE WHAT ARE THE BENEFITS. 10 Advantages of. Design Build
A CLIENT S GUIDE WHERE TO START WHAT HAPPENS ON SITE WHAT ARE THE BENEFITS 10 Advantages of Design Build WHERE TO START Welcome. I prepared this guide after seeing so many people struggle with understanding
More informationSUBSIDIES &THE PERSISTENCE OF TECHNOLOGY ADOPTION
SUBSIDIES &THE PERSISTENCE OF TECHNOLOGY ADOPTION Tara Steinmetz, Assistant Director, Feed the Future Innovation Lab for Assets & Market Access Evidence to Action Summit 25 May 2017 basis.ucdavis.edu Photo
More informationECONOMICS 103. Topic 5: Externalities. External costs and benefits
ECONOMICS 103 External costs and benefits Topic 5: Externalities Marginal external costs, marginal external benefits Marginal social costs and benefits v marginal private costs and benefits Environmental
More informationComparing Economic Systems
Comparing Economic Systems Overview In this lesson, students will discuss how different societies answer the same fundamental economic questions by comparing various economic systems. Grade 10 NC Essential
More informationGuidelines for identifying and designing planned comparisons
Guidelines for identifying and designing planned comparisons Developing value chain innovation platforms to improve food security in East and Southern Africa (VIP4FS) Project (FST/2014/093) November 2016
More informationThe slightest perception of something negative happening can affect an employee s emotional state.
Employee feedback is the core of personal and professional growth. Feedback can help an employee get better at what they do, and surprisingly employees crave feedback. Most managers don t provide enough
More informationEcon Microeconomics Notes
Econ 120 - Microeconomics Notes Daniel Bramucci December 1, 2016 1 Section 1 - Thinking like an economist 1.1 Definitions Cost-Benefit Principle An action should be taken only when its benefit exceeds
More informationMonitoring for Learning and Accountability
GOLDILOCKS TOOLKIT Monitoring for Learning and Accountability Copyright 2016 Innovations for Poverty Action. Monitoring for Learning and Accountability is made available under a Creative Commons Attribution-NonCommercial-NoDerivatives
More informationINTRODUCTION. Choices. Supply and Demand. Economics. Introduction Guide Questions to Consider
INTRODUCTION Introduction Guide Questions to Consider Choices What affects how people make choices? Why do ECONs study choices? Supply and Demand What does it mean when ECONs say "supply and demand"? How
More informationEnterprise Best Practices. Enhanced Performance Management (EPM) General Presentation. Arsalan Safari MIT-SSRC, February 19, 2014
Enterprise Best Practices Enhanced Performance Management (EPM) General Presentation Arsalan Safari MIT-SSRC, February 19, 2014 For Academic Purposes Only (Please Do Not Distribute) Agenda No. Topic 1
More informationManagerial Accounting Prof. Dr. Varadraj Bapat Department of School of Management Indian Institute of Technology, Bombay
Managerial Accounting Prof. Dr. Varadraj Bapat Department of School of Management Indian Institute of Technology, Bombay Lecture - 32 Standard Costing, Mix, Yield, Sales and Fixed Overhead Variances The
More informationCase study 1: What, why and how of impact evaluations
Case study 1: What, why and how of impact evaluations Shubhra Mittal Senior Policy and Training Manager, J-PAL South Asia Kathmandu, March 28, 2017 I. Introduction to J-PAL II. Why Evaluate: Case study
More informationNOTE 6: Identifying an Appropriate Impact Evaluation Method
NOTE 6: Identifying an Appropriate Impact Evaluation Method T he objective of this note is to provide practitioners with an overview of the different tools available for an impact evaluation and to provide
More informationPrice Ceilings and Price Floors *
OpenStax-CNX module: m48632 1 Price Ceilings and Price Floors * OpenStax This work is produced by OpenStax-CNX and licensed under the Creative Commons Attribution License 4.0 By the end of this section,
More informationBECOMING A Data-Driven. HR Function
BECOMING A Data-Driven HR Function Introduction Within any given day, you are probably confronted with a myriad of business decisions, and even more data culled to help you make the right choice. With
More informationLecture 7 - Food Stamps: The Whitmore Study
Lecture 7 - Food Stamps: The Whitmore Study 14.03, Spring 2003 1 The value of food stamps: Policy questions What are the key policy questions you would want to answer in comparing cash to in-kind food
More informationLet us introduce you to Course Match
1 Let us introduce you to Course Match 2 In order to understand course match you need to know three terms. Utilities We re using utility here as an economic term. If you aren t already you ll be very familiar
More informationConserve to Enhance: Linking Water Conservation to the Environment
Conserve to Enhance Webinar Presentation Notes February 22, 2012 Conserve to Enhance: Linking Water Conservation to the Environment Thank you for your interest in Conserve to Enhance and this presentation.
More informationThree steps to joining and participating in unions
Anger hope action Three steps to joining and participating in unions 1. Anger The first condition for joining or becoming involved in the union is anger. Many people are uncomfortable about expressing
More informationThe Ascending Bid Auction Experiment:
The Ascending Bid Auction Experiment: This is an experiment in the economics of decision making. The instructions are simple, and if you follow them carefully and make good decisions, you may earn a considerable
More informationClinical Trials: What You Need to Know
Clinical Trials: What You Need to Know Knowing all you can about clinical trials can help you feel better when deciding whether or not to take part in one. This guide addresses many basic questions and
More information12.0 IMPLEMENT THE PROJECT
12.0 IMPLEMENT THE PROJECT Tasks: à Produce and distribute vessels, disinfectant and educational/promotional materials à Launch the pilot project (special event) à Supervise and support activities to implement
More informationThe economics of competitive markets Rolands Irklis
The economics of competitive markets Rolands Irklis www. erranet.org Presentation outline 1. Introduction and motivation 2. Consumer s demand 3. Producer costs and supply decisions 4. Market equilibrium
More informationSponsored Search Markets
COMP323 Introduction to Computational Game Theory Sponsored Search Markets Paul G. Spirakis Department of Computer Science University of Liverpool Paul G. Spirakis (U. Liverpool) Sponsored Search Markets
More informationAchieving World Class Safety Performance Through Metrics
Session No. 710 Achieving World Class Safety Performance Through Metrics Introduction John W. Russell, MS, PE, CSP, CPE, CPEA, ARM, PCMH Technical Director Liberty Mutual Group Irving, TX Metrics are a
More informationWMI 606: Research Methods Course Tools and data sources session 5
WMI 606: Research Methods Course Tools and data sources session 5 Thumbi Mwangi 1 Paul G. Allen School for Global Animal Health, Washington State University 2 Centre for Global Health Research, Kenya Medical
More informationLecture 10 Pay and Productivity
Lecture 10 Pay and Productivity 1 Introduction Ensuring that your employees take actions that are in the best interest of the firm can be a difficult problem One of the more difficult problems is ensuring
More informationBusiness Analytics & Data Mining Modeling Using R Dr. Gaurav Dixit Department of Management Studies Indian Institute of Technology, Roorkee
Business Analytics & Data Mining Modeling Using R Dr. Gaurav Dixit Department of Management Studies Indian Institute of Technology, Roorkee Lecture - 02 Data Mining Process Welcome to the lecture 2 of
More informationGame theory (Sections )
Game theory (Sections 17.5-17.6) Game theory Game theory deals with systems of interacting agents where the outcome for an agent depends on the actions of all the other agents Applied in sociology, politics,
More informationRandomized experiments
Majeure Economie September 2011 1 Limits of OLS 2 What is causality? A new definition of causality Can we measure causality? 3 Solving the selection bias Potential applications Advantages & Limits 4 Education
More informationIn the Netherlands social procurement is called social return, which is the abbreviation for social return on investment (SROI).
SMEs cooperate to meet social procurement conditions Presentation http://www.useconference.com/homeuse 1 Good morning Cooperation and dialogue, those are important terms these days. Certainly when I read
More informationREPUBLIC OF KENYA. Terms of Reference - Field Supervisor Individual Consultant March I. Summary
REPUBLIC OF KENYA I. Summary Ministry of Public Service, Youth and Gender State Department for Public Service and Youth Kenya Youth Employment and Opportunities Project (KYEOP) Terms of Reference - Field
More informationBuilt on Values Overview. SLIDE 1: Built on Values Overview, Ann Rhoades and Gayle Watson. People Ink
SLIDE 1: Built on Values Overview, Ann Rhoades and Gayle Watson People Ink 2015 1 SLIDE 2: Good to Great: Why Some Companies Make the Leap and Others Don t, a bestselling management book written by Jim
More informationAim of the Course. Behavioral Economics. Why Are We Here? Why Are You Here? Some Things to Bear In Mind. Positive vs Normative Economics 1/20/2017
Aim of the Course Behavioral Economics Mark Dean Spring 07 Columbia University An introduction to the main topics in behavioral economics Theories of economic behavior that fall outside the standard model
More informationSelected brief answers for review questions for first exam, Fall 2006 AGEC 350 Don't forget, you may bring a 3x5" notecard to the exam.
1 Selected brief answers for review questions for first exam, Fall 2006 AGEC 350 Don't forget, you may bring a 3x5" notecard to the exam. These are brief answers intended to help you find the complete
More informationCourse Match. Contents click to follow content links. User Manual v1.3
Course Match User Manual v1.3 Contents click to follow content links Introduction 2 Overview 2 Preferences 2 Clearing Prices 2 Budgets 2 Preference Reporting 2 Clearing Prices /schedule establishment 2
More informationHOW TO KEEP EMPLOYEES MOTIVATED, EVERY SINGLE DAY
HOW TO KEEP EMPLOYEES MOTIVATED, EVERY SINGLE DAY P L A N N I N G, C O N D U C T I N G, A N D G E T T I N G R E S U L T S Through my own research and a LOT of trial and error, I have identified 16 keys
More informationReflections on a Hypothesis: Lessons for Policy and Corporate Practice
Reflections on a Hypothesis: Lessons for Policy and Corporate Practice Professor Michael E. Porter Harvard Business School Landsberg Lecture Resources for the Future Washington, DC January 19, 2011 No
More informationMidterm Review. B. How should the government intervene? - Often multiple options; to choose, need answer to know effects of policies.
14.41 Public Economics Section Handout #5 Midterm Review I. Intro to Public Economics & Micro Review A. When should the government intervene? - Lesson of basic micro: the private market equilibrium is
More informationLean Leader Manual. How to Manage Operations in a Lean Environment
Lean Leader Manual How to Manage Operations in a Lean Environment About the Author Dan Burgos is an experienced business professional. With over 10 years of hands-on experience leading, and coaching organizations
More informationBEST PRACTICES: Ten Steps to Selecting the Right CRM Software
BEST PRACTICES: Ten Steps to Selecting the Right CRM Software The Ten Steps for CRM Software Selection In this brief guide, we ll review a ten-step process that will help you select the right customer
More informationTHE FRANCHISE ONBOARDING PLAYBOOK
THE FRANCHISE ONBOARDING PLAYBOOK PRE-GAME THOUGHTS It wasn t that long ago that employers could hold a one- or two-day orientation program for new hires and pat themselves on the back for a job well done.
More informationCustomer Service Interview Questions
Customer Service Interview Questions Did you know? According to the U.S. Department of Labor Statistics, making a bad hiring decision can cost employers 30 percent of the individual's potential earnings
More informationThree Key Gender Differences That Can Create the Perfect Sales Team
Three Key Gender Differences That Can Create the Perfect Sales Team A Selling In The Skirt Special Report Disclaimer: This report is not about how to coddle women, curse men, or cajole sales teams into
More informationSearching beyond the lamppost: Let s focus on economically relevant questions
University of Heidelberg Department of Economics Discussion Paper Series No. 486 Searching beyond the lamppost: Let s focus on economically relevant questions Jörg Oechssler August 2009 Searching beyond
More informationWhy Good Incentive Plans Fail. And, How to Keep your Great IC Plans out of the LOSER Category
Why Good Incentive Plans Fail And, How to Keep your Great IC Plans out of the LOSER Category Presented by Bob Davenport, Vice President & Managing Director Sales Force Effectiveness Consulting Hay Group
More informationScale Innovations. Farmers First. Executive Summary
Executive Summary The number of customers served by an organization is a critical factor in its overall impact on the world. Finding a high- impact idea is of course difficult, but the transition from
More informationORION RESOURCES Solving the puzzle of smart hiring. Retained Search Quality A La Carte
ORION RESOURCES info@orionresources.com 206-382- 8400 Solving the puzzle of smart hiring. At Orion, we think it s time for some much needed innovation in recruiting. Why? Because standard recruiting services
More informationProven Strategies for Finding Profitable Seller Carryback Notes
Advanced Seller Data Services Exclusively serving note investors and brokers since 2004 15685 SW 116 th Avenue Phone: 1-800-992-4536 Suite 136 Fax: 503-549-0589 Tigard, OR 97224 e-mail: sellerdata@comcast.net
More informationTwelve Habits of Highly Collaborative Organizations
less conflict, lower stress, an improved competitive advantage, a higher level of performance, and a healthier bottom line. Twelve Habits of Highly Collaborative Organizations 1. Lead by example. In highly
More informationA post-lunch parable. *Adapted from speech by Vivek Maru, CEO of Namati Legal Empowerment
A post-lunch parable *Adapted from speech by Vivek Maru, CEO of Namati Legal Empowerment What do you see as the primary purpose of impact evaluations? A. Reporting requirement for donors B. As a fundraising
More informationPERFORMANCE APPRAISAL SYSTEM ALERT #6
AFGE Council 220 Serving SSA Teleservice and Field Office Employees in the 50 States, Puerto Rico and the Pacific Islands PERFORMANCE APPRAISAL SYSTEM ALERT #6 What to Ask During Performance Meetings with
More informationThe Current Player Acquisition Process
By Gary Jennison With all of the cutting edge statistical techniques that the industry has unearthed over the last 5 10 years, one thing that has stayed fairly static has been the concept of valuation
More informationSession 9 Compensation and Rewards
Session 9 Compensation and Rewards Rewards vs. Recognition Reward Significant o Year-end or quarterly bonus o Promotion Includes some sort of monetary increase Usually recognizes long term Recognition
More informationMemo: Difference-in-Difference Impact Results
Current Strategy Our annual impact evaluation efforts consist of obtaining wide geographic representation of One Acre Fund farmers and comparing their harvest yields and agricultural profit to those of
More information