Business Data Collection: Some Norwegian, Dutch, and Danish Experiences

Transcription

1 Utilizing Web Technology in Business Data Collection: Some Norwegian, Dutch, and Danish Experiences Gustav Haraldsen, Ger Snijkers Marko Roos, Anne Sundvoll, Torgeir Vik, Hanne-Pernille Stax NTTS, February 2011, Brussels, Belgium

2 Outline Questions? What human tasks can be replaced by technology? How can paper questionnaires be transferred to web? Does the response quality improve? Is the cost and response burden reduced? Tentative answers Cost efficiency reflections Quality issues: Reducing response burden Quantity issues: Implementing improved data collection instruments Cooperation strategy Web Technology in Business Data Collection NTTS, 24 Feb

3 Cost-efficiency i Reflections Cost efficency Time Re sponse int ernal Time quality external PRB The relationship between nominator and denominator The relationship between internal and external cost Measurement challenges above the fraction line Web Technology in Business Data Collection NTTS, 24 Feb

4 Quite easy 29,3 Sources of Response Burden Neither easy nor difficult 9,6 39,9 58 5,8 15,5 Quite difficult E-technical E-Usability Other Layout No of questions Wait for information Terms Calculations Need of help Mismatch Response categories 2,4 3,7 5,7 9,8 13,2 17,5 18,2 25,2 25,9 26,4 27, Web Technology in Business Data Collection NTTS, 24 Feb

5 Matrix Sequence layout: % of trucks with no-cargo reports and % no-cargo reports. 4 quarter 2007 and % 90 % Web Paper 80 % 70 % % of lorries % no-cargo 60 % 50 % 40 % 30 % 20 % 10 % 0 % 4.quarter quarter quarter quarter 2008 Web Technology in Business Data Collection NTTS, 24 Feb

6 Feedback to Help Desk of calls Number Other 12 % Login problems 11 % Year Requests for response delay 11 % Substantial questions 28 % Posting problems 38 % Web Technology in Business Data Collection NTTS, 24 Feb

7 Dutch SBS Paper Questionnaire Web Technology in Business Data Collection NTTS, 24 Feb

8 Web Design Guideline Elements: 1. Be consistent in all parts of the web system 2. Be aware of hidden functionalities 3. Use layout and usability principles that are known to R (country specific) 4. Give overview and provide information on data asked for 5. Split questionnaire into small blocks, small tasks 6. Reading from the screen is different than from paper: use the same visual design principles but tailor to the computer 7. Use short explanations 8. Facilitate completion process using computer functionalities: automatic calculations, printing option 9. Web questionnaire design is communication design. Use dialogs that prevent errors, and correct errors Web Technology in Business Data Collection NTTS, 24 Feb

9 Dutch Web SBS: Web Technology in Business Data Collection NTTS, 24 Feb

10 Improved Administration i ti or Questionnaire? i Structural statistics, manufacturing industry. Response burden and completion time 2004 and 2006 PRB -index Time Paper Web Paper Web One establishment business Multi establishment business Web Technology in Business Data Collection NTTS, 24 Feb

11 Automated Response Questionnaire free Business system Data Error messages Statistical system Web Technology in Business Data Collection NTTS, 24 Feb

12 XBRLbased system Web Technology in Business Data Collection NTTS, 24 Feb

13 Web pick-up rates Norwegian average 2010: 65 % Dutch Annual SBS, 2007: 84 % Total response rate did not change (80%) Dutch average 2008: 51% 3 largest Dutch business surveys (2008): 77 % (STS: 63%, SBS: 80%, Intrastat: 100%) Denmark: 2 80 % Web Technology in Business Data Collection NTTS, 24 Feb

14 How to increase Web rates: Self Reported Sick Leave % 90 % 80 % No paper version with invitation letter 70 % 60 % 50 % 40 % 30 % 20 % 10 % 0 % Idun version introduced Altinn+Idun Idun Altinn Web Technology in Business Data Collection NTTS, 24 Feb

15 How to increase the web pick-up rate Easy access to the web version combined with restricted access to the paper version Offer real advantages Making the respondents aware of the web option Offer practical guidance Computer competence and motivation play a minor part Web Technology in Business Data Collection NTTS, 24 Feb

16 Preferred Response Modes: Self Reported Sick Leave 1.quarter 2010 Paper questionnaire 5,1 % Automated Altinn 11,8 % Altinn web questionnaire 14,5 % Idun web questionnaire 68,6 % Web Technology in Business Data Collection NTTS, 24 Feb

17 How to proceed? Start from a web questionnaire perspective Scientific Approach to the Quality Issue Combination of Qualitative and Quantitative methods Networking: The Copenhagen Initiative > ESS Working Group > Make reports available > Involvement of methodologists Thank you for your attention Web Technology in Business Data Collection NTTS, 24 Feb