STATISTICAL CONSULTATION SERVICE STATISTIESE KONSULTASIEDIENS

Transcription

1 STATISTICAL CONSULTATION SERVICE STATISTIESE KONSULTASIEDIENS

2 SCS s mission To provide a professional, outcomes based statistical consultation service to post-graduate students and researchers at UJ in respect of quantitative research (research methodology, questionnaire design and statistical analysis).

3 Stages of the quantitative research process Stage 1: Formulate research problem Stage 2: Design study Stage 3: Design sampling strategy Stage 4: Collect data Stage 5: Analyse and interpret data Stage 6: Report results (inform others)

4 Training for research If you are not in receipt of training in research methods SCS will be presenting a limited number of courses on research methods-related themes. Ask at Postgraduate Centre. Also look for other training e.g. through Faculty of Education winter school. It s best to experience training just before you need to use the methods.

5 Stage 1: Formulate research problem Choose research problem Focus research question(s) Consult literature Define concepts Develop hypotheses Operationalise variables RESPONSIBILITY: You, in consultation with your supervisor [SCS may provide some feedback on the definitions and concepts used and the effectiveness of operationalisation during the review of the data collection instrument]

6 Stages 2 & 3: Research design: Data collection and sampling Decide on type of survey (self-administered, structured interview, telephone) Define population, establish (a) sampling frame (who is included and excluded), (b) sample size and ( c) sampling method Construct measuring instrument: questionnaire or interview schedule Decide on response categories (levels of measurement) Decide on data analysis techniques to be used Design layout RESPONSIBILITY: You, in consultation with supervisor. At a relatively advanced stage of this process get feedback from SCS (1 ST consultation)

7 Stages 2 & 3: Research design: Data collection and sampling SCS uses a rating scheme based on your research design Green = good to go Orange = some reservations but could proceed with supervisor approval Red = poor, we would recommend significant changes to research design before continuing with research

8 Stages 2 & 3: Research design: Data collection and sampling strategy Following feedback from supervisor and SCS: Revise design, sampling strategy, data collection instrument if necessary Pilot (test) the instrument on a small sample Following review of pilot: Further revise any problematic elements

9 Stage 4: Collect data Identify and meet with subjects (interviewees) and administer questionnaire(s) Record any successes and/or problems experienced during this process RESPONSIBILITY: You

10 Stage 4: Collect data An exception: SCS facilitates data collection via the online survey; the researcher must manage the distribution of the survey url, SCS checks and downloads responses and prepares the data when instructed to close the survey; there is a charge for this service.

11 Stage 5: Capture, analyse & interpret Capture data data RESPONSIBILITY: Currently under review. For small number of questionnaires and few questions then you can capture the data yourself (SCS will show you how to do this). For large number of questionnaires and/or questions then possibly SCS* (you are responsible for delivering questionnaires in hard copy). *SCS contracts out data capture. If funds are available, SCS covers up to R500 of data capture cost.

12 Stage 5: Capture, analyse & interpret Edit/clean data data RESPONSIBILITY: Depends on threat to integrity of data. If minimal corrections, SCS, in consultation with you and your supervisor. If severe problems because of poor instrument design, you. Code data RESPONSIBILITY: You (with advice from SCS, if required).

13 Stage 5: Capture, analyse & interpret Analyze data data RESPONSIBILITY: Depends on complexity of analysis required. Projects will be rated as basic, intermediate, complex. Analysis will be by SCS, in consultation with you and your supervisor, if intermediate or complex. If you are interested in trying to do the analysis yourself SCS will, depending on capacity and other commitments, facilitate this. Interpret results: relate back to theory RESPONSIBILITY: You, in consultation with supervisor and SCS

14 Stage 6: Report results (inform others) Provide theoretical basis of study Describe methods and findings Interpret findings in terms of theoretical basis Draw conclusions and make recommendations RESPONSIBILITY: You, in consultation with your supervisor

15 SCS s main involvement ( ) in the research process - summary Stage 1: Formulate research problem Stage 2: Design study Stage 3: Design sampling strategy Stage 4: Collect data Stage 5: Analyse and interpret data Stage 6: Report results (inform others)

16 SCS does facilitate: Assistance with: Research design Questionnaire design Sample design and sample size determination Capturing of (questionnaire and experimental) data Data cleaning and editing

17 SCS does: Conduct appropriate statistical analyses to answer the research question(s). Where we do not have experience of an advanced or rare statistical procedure and do not have (i) the time to research it and/or (ii) resources to run the procedure, we will attempt to put the researcher in contact with someone who can assist him/her Provide assistance with the interpretation of the statistical results Depending on capacity and other commitments, provide assistance with the graphical display of data Provide electronic copy of the output from data analysis

18 SCS does not: Act as a supervisor / co-supervisor for any student Liaise with a supervisor on behalf of a student Conduct consultations via or the telephone Design questionnaires for the researcher Collect data (except via online survey method) Code responses Report findings / results Analyse open-ended questions (unless you have coded these)

19 SCS cannot take responsibility for: Ethical issues related to a study o Including the secure storage of your questionnaires The validity of data collected by a student The statistical correctness of results as reported by a student

20 How to contact us and where to find us Consultations are done by appointment only: tel: Consultants: Dr Richard Devey (Tel: ; Jaclyn de Klerk (Tel: ; Juliana van Staden (Tel: ; Anesu Kuhudzai (Tel: ; Office: Chiselhurst House, 20 Chiselhurst Ave, Auckland Park. Website:

21 Map

22 USEFUL HINTS: It is not compulsory for you to consult with SCS. If you are using an tried and tested instrument and your supervisor has a lot of quantitative research experience you may not need to consult with SCS However, in most instances it will probably benefit you to consult so: Consult SCS at onset of study when you have a very good idea about (i) what question(s) you are asking, (ii) the population and sample, and (iii) you have a draft data collection instrument for review Appointments are scheduled and data sets analysed on a firstcome-first-serve basis: Allow for up to a 3 week waiting period for an appointment Allow for up to a 3 week waiting period to receive first feedback after submission of questionnaires / data Supervisor attendance at your first consultation is strongly recommended

23 Questions?