ADAPTATION OF THE SDMX

Transcription

1 ADAPTATION OF THE SDMX Under The Thai NSO Context Tidarat Nansing National Statistical Office Thailand

2

3 The Thai National Statistical Office (TNSO) A decentralized statistical system The 2007 Statistical Act has assigned the TNSO to manage and administrate the statistical system of the country, by using the Statistical Master Plan as a tool. Major missions are data production, service on statistical data and information and management of statistical system

4 Adaptation of the SDMX under the TNSO context. Background of Thailand Data Exchange Experience in working on SDMX Future work Challenges Lesson learned

5 Background of Thailand Data Exchange

6 Background of TNSO S Data Exchange Originally, TNSO developed a statxchange system for exchanging statistical data and explanations of statistical data and metadata. With various agencies Using statxml as the central standard for exchanging information in the form of Web Services. The Working Group of Government Data Integration with representatives from 20 ministries was established. The server were installed at 20 Line Ministers and 20 Web services system. Universal Description Discovery and Integration (UDDI) was set up at the Technology and Information Centre, acted as yellow pages in searching linked data, at the time in each Line Ministry, there was tool for receiving and sending data for exchange Currently, the system is still in use. Some agencies have migrated data to the Cloud Technology 2006: IT platform and data sharing at National Statistical Office, Thailand

7 How project works in Thailand

8 How to Input data to statxchange system Entry data by user 3 Web Input Internal Data Datasource Import File 2 CSV Template statxchange System External Data DataBase/ Datawarehouse 1 XML Converter Program statxchange DB Web services/data sharing On website 2006: IT platform and data sharing at National Statistical Office, Thailand

9 Experience in working on SDMX

10 Experience in working on SDMX โครงการจ ดทาสารสนเทศและต วช ว ดเพ อการพ ฒนาประเทศ (Key National Development Indicator : KNDI) 10

11 Experience in working on SDMX: SDMX UN-Country Data A Project on UNSD-DFID Project

12 How project works in Thailand NSO Staff trained (IT related) NSO staff were trained - SDMX and national registry set-up NSO respond for input our data and metadata related to MDG Support the line agency to input their own data to the system and share to each other

13 Experience in working on SDMX INDICATOR LIST and CODELIST between statxml and MDG DSD Ex: Under-five mortality rate (per 1,000 live births) FREQ = A SERIES = SH_DYN_MORT UNIT = PER_1000_LIVE_BIRTHS LOCATION = T AGE_GROUP = 000_005_Y SEX = T REF_AREA = THA SOURCE_TYPE = NA UNIT_MULT = 0 NATURE = NA SOURCE_DETAIL = Ministry of Public Health StatXML

14 Experience in working on SDMX

15 THAILAND : SDMX Registry Once converted, SDMX data is placed on a Web server and registered with Fusion Registry, installed with UNSD assistance Fusion Registry is an advanced implementation of the SDMX Registry specification, developed by Matadata Technology.

16 Experience in working on SDMX

17 2014 Implementing SDMX in statxchange v.2 DATA COLLECTION Data Entry System Excel Loader DATA COLLECTION DATA PROCESS Oracle BI DATA SERVICE DATA PROCESS ETL :DATA WAREHOUSE Data Entry System DATA EXCHANGE DATA SERVICE BI tool Web search ETL NSI.Net Client DATA EXCHANGE Based on the SDMX Reference Infrastructure(SDMX-RI) provided by Eurostat

18 STATXCHANGE V.2 OVERVIEW statxchange 2014: IT platform and data sharing at National Statistical Office, Thailand

19 DATA EXCHANGE

20 Model Design to sharing data using SDMX Concept; Main steps to design for using IT Tools in TNSO Study Official Statistic data (OS DATA) Create Matrix Sheet of OS List Consider/create common Code List Mapping Table data and DSD Create CodeList ConceptSchemes, DSD (sw: DSW / SAE) Design Concept, DSD (excel) Data sharing with other agencies as required. statxchange V.2

21 SDMX infrastructure and tools Based on the SDMX Reference Infrastructure provided by Eurostat Developed to support data exchange via web services in SDMX-ML format Expose the data to be pulled (WS, HUB)

22 SDMX infrastructure and tools Based on the SDMX Reference Infrastructure provided by Eurostat

23 SDMX infrastructure and tools Based on the SDMX Reference Infrastructure provided by Eurostat

24 Future work The TNSO new additional missions The Implementation of the 2 nd Statistical Master Plan The Management of Information System (MIS) of the country The Implementation of the Competitiveness Indicators. The Implementation of the 2030 Sustainable Development Agenda (SDGs) to TNSO. IT TOOLS AND INFRASTUCTURE The TNSO is expecting to construct the full automatic system to implement Database system for Web Portal and Web Services. Web service system according to international standards. Web Portal system for statistical information services. BIG DATA Analytic OPEN DATA concept

25 Challenges Most of the stakeholders are not familiar with SDMX. Statistical units of the Line Ministries are not fully aware of mutual benefits. SDMX implementation requires high level policy involvement in settling provision agreement. Statisticians and IT persons need to work more synergized.

26 Lesson learned Project continuity and regular monitoring are needed. Personnel skills should be always enhanced. Silo system is rather problematic. Connectivity among statistical units must be improved. Gap in communication.

27