Session II Reviewing the purpose/focus of the Survey Expert Group Meeting UN e-government Survey 2018 New York, UN Headquarters (Conf. Room E) May 10-11, 2017 External Evaluation of the e-government Survey for the Period 2001-2016 Edward M. Roche, Ph.D., J.D. Evaluation Consultant
Evaluation Areas & Scoring Methodology Relevance Effectiveness Impact Sustainability A R A HS Highly Satisfactory S Satisfactory MS Moderately Satisfactory MU Moderately Unsatisfactory U Unsatisfactory HU Highly Unsatisfactory
The Evaluation Relies on Data from Interviews, Internal UN Documents, and the Public Record Interviews UN Personnel Member Nations Experts Other Its Admin Staff Regional Reps Others Target 23 Advisory Missions Advisory Mission Documents Web Traffic Data Internal Documents Other Data Citation Analysis From UN.org gcios Document Review All Reports Target 5 gcios (1.5 hr interview including entire team) Scientific Literature Other e-gov Measurements Online Survey All Stakeholders
Preliminary Conclusions
The e-gov Survey Attracts up to 3,300 Downloads/Day and is a Flag Ship Publication of the United Nations Table 4: Recent download volume for the e-government Survey has ranged from approximately 2 1 to 1 million per year. Table from Draft Report 2014 2015 2016 1,072,760 1,172,600 430,745 Timing Issue Social Media Promotion Note: Does not account for sharing (which would greatly increase the numbers).
Citation Analysis Shows Remarkable Synergy Between Scientific Literature and the e-government Survey 80000 REFERENCES TO E-GOVERNMENT IN SCIENTIFIC LITERATURE 70000 60000 50000 40000 30000 20000 DPADM BEGINS E-GOV SURVEY 10000 0 1950 1960 1970 1980 1990 2000 2010 2020
Use by Member Nations
The e-gov Survey is Used Extensively by Member Nations and International Organizations Table 5: The e-government Survey has had a powerful impact on policy-making within nation states, but also within international fora. Fora Level International Organizations Inter-Governmental Regional Fora Government Ministry Positive Influence of e-government Survey (a) Frequent use by World Bank, UNESCO, and other international organizations within the United Nations systems; (b) Data from e- Government Survey is integrated into parallel statistics from the European Union; (c) e-government Survey is o cial is o cial database for the Davos World Economic Forum. (a) Provides lingua franca and common point of reference for initiation of discussions on regional cooperation; (b) Aids in formulation of regional strategies. (a) Provides framework for the purpose of benchmarking against neighboring nation states; (b) For the purpose of obtaining policy guidance for delivery of basic services consistent with the The Millennium Development Goals. For the purpose of guiding their investments and program priorities, the e-government Survey has been used extensively by individual ministries within member governments. Table from Draft Report
Methodology Core Flexibility Value
The Methodology of the Readiness Score Represents a Formula of: Core + Flexibility + Value Analytical Frameworks Supplementary Measurements Value Added for Member Nations Flexibility Core Measurements Stability rt o p e R Draft r o F l l a Will C More rk s o w e Fram
The e-gov Survey is Not Simply a Report It is an Entire Eco-System
The e-gov Survey is not merely a Report It is an Entire Eco-System Inquiry System Best Practices Forum Web Cast Inquiry System Vendor Gateway Fast Track Services gcio World Bank OECD Other I.O. ITU Advisory Missions EU Regional Workshops Vendors Analytical Reports SDGs e-gov Survey DPADM Development Management Executive Learning Capacity Building Frameworks Incremental Empiricism Measurement System Civil Society Academia Others
Discussion
Session II: Reviewing the purpose/focus of the Survey Possible Discussion Topics Expanding to encompass each of the 17 Sustainable Development Goals Going backward to measure more of Public Administration ICT infrastructure (and uses) Development of more supportive and interpretative Frameworks Leveragability of sub-variables comprising the Readiness Score