Statistical metadata: a unified approach to management and dissemination

Transcription

1 Statistical meta: a unified approach to management and dissemination Marina Signore, Mauro Scanu, Giovanna Brancato Istat NTTS 2013 Brussels, 7 march 2013

2 SUM: Istat Unified Meta System Pillar of STAT2015: Istat Modernization Program Purposes: Data retrieval and usability Meta reuse Traceability Integration Need to go beyond structural and reference meta by managing also management meta Unified Management conceptualization, meta management and dissemination of the three different meta categories meta useful for the management of a NSI, in planning, running and assessing both statistical and support activities. 1 They allow to connect and processes with the NSI strategic objectives; to Conceptual assign responsibilities model for describing and resources the SPP to the objectives; to plan schedules and Modelling timetables structural of the different meta goal s and limitations actions; and of existing to link the standards objectives to the different Joint management use of reference plans and of the management Institute (e.g. meta the long term goals) Presentation

3 Modelling meta in the statistical production process SPP 3 CUR QUID QUOMODO QUIBUS AUXILIIS QUIS & UBI QUANDO QUANTO Statistical datum structural meta and conceptual statistical (reference) operations meta (e.g. GSBPM) reference meta management or administrative activities management meta quality control actions (e.g. SIDI/SIQual approach) quality methodologies (reference) meta empirical solutions Thesauri of standard terms IT tools (statistical generalised software) reference meta operation s responsible operation s executor other actors involved in the operation management meta operation validity periods & changes in the operations resources: human, IT costs: financial, time for statistical and administrative operations and quality activity management meta

4 Modelling meta in the statistical production process CUR SPP QUID QUOMODO QUIBUS AUXILIIS QUIS & UBI QUANDO The proposed model allows to define structural and reference meta and management meta. The role of the quality control activity is emphasized given that it is integrated to the process and to standard quality indicators The proposed approach can be considered as an enrichment of the GSBPM where quality management and meta are considered overarching activities 3 QUANTO

5 Structural meta Definition (SDMX, 2009, Androvitsaneas, Sundgren, Thygesen, 2006) Identifiers of the structure of the, e.g. names of columns of micro tables or dimensions of statistical cubes; Identifiers of the structure of associated meta, e.g. units of measurement. Our objective is to make use of structural meta along the statistical process (from collection up to dissemination) for different purposes (research, reuse, traceability and integration) in accordance with international standards. International standards GSIM SDMX compliance with definitions and structures in use for aggregated dissemination through a single exit point, with standardized meta 4

6 Structural meta and SDMX Hence, we are using SDMX through a meta organization that gives a statistical role to the SDMX artefacts, following GSIM concepts, e.g.: Population/statistical units: code lists in accordance and coordinated with the already existing ones in SIDI/SIQual Variables: organized in appropriate concept schemes (for both categorical and numerical s) Statistical operators: code list of the operators used for transforming in two subsequent phases (e.g. average, median, total when passing from validated to analysed ) SDMX should be improved in order to describe meta relationships along the statistical process 5

7 7. DISSEMINATION Structural meta and SDMX Meta Micro Meta Macro 4.COLLECT 5. PROCESS 6 ANALYSE Frame Data structure Frame population Num. var. for prop. design Unit of measure Design 6 Sample selection Elementary Questionnaire Survey unit Numerical question Unit of measure Coded question Check, edit, codying disclosure controls Validated micro Data structure Analysis unit Numerical Unit of measure Qualitative Statistical operator (from micro to macro ) Preaggregated or output Data structure Analysis population Numerical Unit of measure Qualitative Operator (balance, index number, ratio,..) Marginalization of a categorical/qualitative Statistical output obtained from two preaggreated (ratio, balance, ) or marginalization Data structure Qualitative

8 Joint use of reference and management meta Meta and quantitative measures to support strategic planning and overall assessment are needed in order to face new challenges Para: about the survey operations, (e.g. the times of day interviews were conducted) and about administrative activities (e.g. number and expertise of available resources, activities implementing strategic objectives, methodological investments, training, ) Quality indicators: measures of the quality of statistical products or processes. Istat is trying to establish stricter links between quality assessment and management activities in order to support an evidence-based decision process and enable middle and top managers to accomplish a more comprehensive analysis of statistical production processes widening the range of improvement actions beyond the statistical aspects. 7

9 SUM: Istat Unified Meta System Meta management system Strategic planning Management meta Reference meta Structural meta Overall assessment Specify need Design Build Collect Process Analyse Disseminate Archive Evaluate Documentation (Long Term Goals, methodological/it plans, survey architecture, sampling design, ) Raw (including administrative ) Validated Intermediate aggregated Corporate warehouse Output Publications Quality reports 8