External Evaluation. Session II Reviewing the purpose/focus of the Survey

Transcription

1 Session II Reviewing the purpose/focus of the Survey Expert Group Meeting UN e-government Survey 2018 New York, UN Headquarters (Conf. Room E) May 10-11, 2017 External Evaluation of the e-government Survey for the Period Edward M. Roche, Ph.D., J.D. Evaluation Consultant

2 Evaluation Areas & Scoring Methodology Relevance Effectiveness Impact Sustainability A R A HS Highly Satisfactory S Satisfactory MS Moderately Satisfactory MU Moderately Unsatisfactory U Unsatisfactory HU Highly Unsatisfactory

3 The Evaluation Relies on Data from Interviews, Internal UN Documents, and the Public Record Interviews UN Personnel Member Nations Experts Other Its Admin Staff Regional Reps Others Target 23 Advisory Missions Advisory Mission Documents Web Traffic Data Internal Documents Other Data Citation Analysis From UN.org gcios Document Review All Reports Target 5 gcios (1.5 hr interview including entire team) Scientific Literature Other e-gov Measurements Online Survey All Stakeholders

4 Preliminary Conclusions

5 The e-gov Survey Attracts up to 3,300 Downloads/Day and is a Flag Ship Publication of the United Nations Table 4: Recent download volume for the e-government Survey has ranged from approximately 2 1 to 1 million per year. Table from Draft Report ,072,760 1,172, ,745 Timing Issue Social Media Promotion Note: Does not account for sharing (which would greatly increase the numbers).

6 Citation Analysis Shows Remarkable Synergy Between Scientific Literature and the e-government Survey REFERENCES TO E-GOVERNMENT IN SCIENTIFIC LITERATURE DPADM BEGINS E-GOV SURVEY

7 Use by Member Nations

8 The e-gov Survey is Used Extensively by Member Nations and International Organizations Table 5: The e-government Survey has had a powerful impact on policy-making within nation states, but also within international fora. Fora Level International Organizations Inter-Governmental Regional Fora Government Ministry Positive Influence of e-government Survey (a) Frequent use by World Bank, UNESCO, and other international organizations within the United Nations systems; (b) Data from e- Government Survey is integrated into parallel statistics from the European Union; (c) e-government Survey is o cial is o cial database for the Davos World Economic Forum. (a) Provides lingua franca and common point of reference for initiation of discussions on regional cooperation; (b) Aids in formulation of regional strategies. (a) Provides framework for the purpose of benchmarking against neighboring nation states; (b) For the purpose of obtaining policy guidance for delivery of basic services consistent with the The Millennium Development Goals. For the purpose of guiding their investments and program priorities, the e-government Survey has been used extensively by individual ministries within member governments. Table from Draft Report

9 Methodology Core Flexibility Value

10 The Methodology of the Readiness Score Represents a Formula of: Core + Flexibility + Value Analytical Frameworks Supplementary Measurements Value Added for Member Nations Flexibility Core Measurements Stability rt o p e R Draft r o F l l a Will C More rk s o w e Fram

11 The e-gov Survey is Not Simply a Report It is an Entire Eco-System

12 The e-gov Survey is not merely a Report It is an Entire Eco-System Inquiry System Best Practices Forum Web Cast Inquiry System Vendor Gateway Fast Track Services gcio World Bank OECD Other I.O. ITU Advisory Missions EU Regional Workshops Vendors Analytical Reports SDGs e-gov Survey DPADM Development Management Executive Learning Capacity Building Frameworks Incremental Empiricism Measurement System Civil Society Academia Others

13 Discussion

14 Session II: Reviewing the purpose/focus of the Survey Possible Discussion Topics Expanding to encompass each of the 17 Sustainable Development Goals Going backward to measure more of Public Administration ICT infrastructure (and uses) Development of more supportive and interpretative Frameworks Leveragability of sub-variables comprising the Readiness Score