The Survey Process 101 An Overview in Surveying

Transcription

1 The Survey Process 101 An Overview in Surveying Photo by lastyearsgirl_ on Flikr Photo by roboppy on Flikr Photo by elkit on Flikr

2 I Where Do I Begin? V Timeliness VI Sources of Photo by herzogbr on Flikr

3 I V Timeliness VI Sources of 1. Define Survey Objectives Specify the target population Determine type of data to collect Assess the desired result precision 2. Determine Who Will Be Sampled Probability or convenience Develop sampling frame (if necessary) Select sample 3. Create & Test Survey Instrument Choose the response mode Draft questions Pretest the survey Revise the survey 4. Contacting Respondents Pre-notification Reminders and thank you Non-response follow-up 5. Data Collection, Reduction, & Analysis

4 I V Timeliness VI Sources of Interaction with participants has three components: Contact Response Each component can be conducted in a different mode: Telephone Mail Web Response modes can be interviewer or self- administered Responses can be collected using single or mixed methods

5 I V Timeliness VI Sources of Probability Sampling Random Sampling Probabilities of selection are known for everyone in the population Allows for valid inference on entire population Expensive to conduct Convenience Sampling Cannot determine probabilities of selection for everyone Do not support statistical inference Good for collecting non-inferential data Less time and effort Less cost

6 I Probability Sampling Measured relative to sampling frame size Discrepancy between sampling frame and target population results in coverage error V Timeliness VI Sources of Convenience Sampling No sample frame, therefore response rates not meaningful Can still be reported

7 I V Timeliness VI Sources of Researcher s Time Survey design Data analysis Varies by size of survey Varies little by mode chosen Labor & Personnel Costs Varies based on size and complexity Cost dramatically different based on mode Most to Least Expensive Interview Telephone Mail /Web Instrument Costs Printing Programming Postage Other supplies

8 Time of survey process varies based on contact, response, and follow-up modes I Most relevant measure is maximum response time Resource availability increases or decreases fielding period for all modes V Timeliness VI Sources of Fastest to slowest by mode Telephone Mail Mail, , & the Web Face-to-face

9 I V Timeliness VI Sources of Coverage Failure to give any chance of selection to some individuals in the population Measured by differences on frame and target population Sampling Inferences made on entire population when information collected only on a sub-set of population Variance and bias measure uncertainty Non-Response Individual does respond to entire survey or particular items on a survey Measured by response rate Measurement Result from interviewer influence, poor questionnaire i wording, error due to effects of mode, respondent error Varies by mode response mode

10 I V Timeliness VI Sources of Data Quality Increases With: Low non-response rates Honesty on surveys and individual questions Completeness of responses Low error rate Non-response rate is lower in intervieweradministered modes than self-administered modes Interviewer-administered modes result in more socially acceptable answers than selfadministered modes Quality of data transcription an issue with non-electronic modes

11 Questions or Comments? I V Timeliness VI Sources of Photo by Manchester Library on Flikr Reference Schonlau, M., Fricker, Jr., R.D., & Elliot, M.N. (2002). Conducting Research Surveys via and the Web. Santa Monica: RAND.