Document for item 3.3 of the agenda

Transcription

1 EUROPEAN COMMISSION EUROSTAT Directorate F: Social Statistics Unit F-3: Labour market statistics and lifelong learning Doc.: Eurostat/F3/LAMAS/28/17 WORKING GROUP LABOUR MARKET STATISTICS Document for item 3.3 of the agenda SDMX DSD version 2.1 for LCI October 2017 AMPERE Building Luxembourg LAbour MArket Statistics working group 10-11/10/2017 Page 1

2 Summary: the aim of this document is to inform the LAbour MArket Statistics (LAMAS) Working Group (WG) of (1) the state of play as regards LCI transmissions in SDMX - DSD version 2.0 and (2) the limited changes introduced in DSD version 2.1 as well as (3) the plans to switch to this new version in production. I. BACKGROUND Eurostat has engaged in a general overhaul of the existing Data Structure Definitions used for Job Vacancy Statistics and the Labour Cost Index. One of the aims pursued was to move from JVS- (or LCI-) specific code lists to international standards that would pave the way for easy transmission of the corresponding datasets between Member States and international organisations. Member States started testing the new SDMX DSD version (2.0) as of April/May 2016 and most of them implemented them in production in the 2 nd half of On the output side, Eurostat adopted SDMX DSD version 2.0 for its transmissions to ECB starting in December By the end of 2016, ECB asked for limited changes in SDMX DSD version 2.0 that implied creating a new version (SDMX DSD version 2.1). In 2017, international organisations (ILO, OECD, ECB, Eurostat) launched a project to define Data Structure Definitions for all flows of aggregated data between institutions, in the field of labour market statistics. This project should result in common standards adopted at international level, for the exchange of labour market statistics including the Labour Cost Index. However, as the experience gathered in Europe for LCI fed into this project, the impact on SDMX DSD for LCI should remain minimal. II. STATE OF PLAY The table below provides an overview of the transmission of LCI_INDEX (resp. LCI_WEIGHTS) in SDMX for reference quarter 2017Q1 due in June 2017 (resp. last weights transmitted as of 21 June 2017). LAbour MArket Statistics working group 10-11/10/2017 Page 2

3 Table 1: Formats used in the transmission of LCI_INDEX and LCI_WEIGHTS LCI_INDEX (2017Q1 data) Last LCI_WEIGHTS transmitted (as of 21 June 2017) Formatted Table COMPACT_ COMPACT_ Csv Csv SDMX file SDMX file (DSD Errors file file (DSD version 1.0) version 2.0) COMPACT_ COMPACT_ SDMX file (DSD SDMX file (DSD Errors version 1.0) version 2.0) BE X X X BG X X CZ X X X X DK X X X X DE X X EE X X X X IE X X EL X X ES X X FR X X IT X X CY X X LV X X X X LT X X LU X X X HR X X X HU X X MT X X X X NL X X X AT X X PL X X PT X X RO X X X SI X X SK X X FI X X X SE X X UK X X NO X X X X MK CH Formatted: Font: 8 pt Formatted: Font: 9 pt LAbour MArket Statistics working group 10-11/10/2017 Page 3

4 TR X RS X As shown in table 1, all countries but 2 (Turkey and Serbia) have adopted the SDMX DSD version 2.0 for their transmissions of both LCI Indices and weights. Deleted: now This good result should be somewhat mitigated by the fact that a number of transmissions include errors which delay LCI production. In 6 cases (CZ, DK, EE, LV, MT and NO), these errors concern both LCI and weights. In 5 cases (BE, HR, NL, RO and FI), errors were found in the LCI transmissions only whereas there was 1 case (LU) that concerned weights only. In the next production rounds, Eurostat expects that these IT errors will be corrected at source, with the help of STRUVAL programmes that will be integrated with Edamis. III. CHANGES INTRODUCED IN SDMX DSD version 2.1 The changes introduced in the new version of DSD concern one dimension (seasonal adjustment) and three attributes (unit of measure, embargo time and base period) as described in the following text. Deleted: SDMX Seasonal adjustment As regards seasonal adjustment, the only change consists in using the code list CL_ADJUSTMENT (version ESTAT 1.4 of the SDMX Registry) instead of CL_SEASONAL_ADJUST (version ESTAT 1.0). Deleted: sdmx Deleted: r The reason for this change is the need to have a code: '_Z' for cases where seasonal adjustment is not applicable. It has no impact on the content of the SDMX message as the concept mnemonic (SEASONAL_ADJUST) remains unchanged. Unit_measure The concept mnemonic used for units was changed from 'Unit' to 'Unit_measure' to comply with version 1.0 of the SDMX glossary agreed at international level (see at Embargo_time With the new version, it will be possible to specify an embargo date and time at the observation level. It must be noted that this attribute is not mandatory meaning that for most countries this change will have no impact in practice. Moreover, there is currently no LCI data transmitted under embargo. LAbour MArket Statistics working group 10-11/10/2017 Page 4

5 In addition to the above changes, the description of the statistical concepts was revised in order to clarify their meaning and purpose (see: "Doc 28 - Item SDMX 2.1 for LCI.docx - Annex 1 - guidelines - track changes.docx"). Base period Formatted: Justified Deleted: Page Break The code (concept mnemonic) for the base period has been changed from BASE_YEAR to BASE_PER in accordance with the SDMX glossary. Other changes Switching from SDMX DSD version 2.0 to SDMX DSD version 2.1 is an opportunity to minor issues regarding: - Filling under <ID> the exact filename used for Edamis transmissions; - Change the test status from 'True' to 'False' The move from SDMX DSD version 2.0 to SDMX DSD version 2.1 was also an opportunity to prepare for the transmission of labour cost levels data by including the corresponding variables in the indicators code list, as follows: HLC_O Hourly labour costs other than wages and salaries, annual data LEVELS_A M HLC_T Total hourly labour costs, annual data LEVELS_A M HLC_TXB Total hourly labour costs excluding bonuses, annual data LEVELS_A C HLC_WAG Hourly wages and salaries, annual data LEVELS_A M The transmission of labour cost levels in SDMX DSD version 2.1 will simplify the loading and validation of national estimates which concerns 8 Member-States (AT, DK, ES, FR, HU, NL, RO, CZ). Deleted: 0 Impact The impact of the switch to SDMX DSD version 2.1 for LCI indices and weights will be very limited as shown in the example below taken from: "Doc 28 - Item SDMX 2.1 for LCI.docx - Annex 1 - guidelines - track changes.docx". Changes are highlighted in red fonts. <?xml version="1.0" encoding="utf-8"?> <!-- Created with SDMX Converter v > <CompactData Part 1, the metadata xmlns=" xmlns:lci="urn:sdmx:org.sdmx.infomodel.keyfamily.keyfamily=estat:lci:2.1:compact" xmlns:xsi=" xsi:schemalocation=" SDMXMessage.xsd urn:sdmx:org.sdmx.infomodel.keyfamily.keyfamily=estat:lci:2.1:compact ESTAT_LCI_Compact.xsd"> <Header> <ID> LCI_INDEX_Q_BE_2014_0004_V0001 </ID> <Test> false </Test> <Truncated>true</Truncated> LAbour MArket Statistics working group 10-11/10/2017 Page 5

6 <Prepared> T14:01: :00</Prepared> <Sender id="be1"> <Contact> <Name xml:lang="en">statbel </Name> <Name>Charles Philippe</Name> <Department>6401</Department> </Contact> </Sender> <Receiver id="4d0"> <Name xml:lang="en">eurostat</name> <Contact> <Name xml:lang="en"> Hubertus Vreeswijk</Name> < > </Contact> </Receiver> <DataSetID>LCI_INDEX_Q </DataSetID> Part 2, the general information </Header> <lci:dataset> <lci:series FREQ="Q" REF_AREA="BE" SEASONAL_ADJUST="W" INDICATOR="LCI_T" ACTIVITY="B" UNIT_MEASURE="IX" UNIT_MULT="0" TIME_FORMAT="P3M" BASE_PER="2012" TIME_PER_COLLECT="A"> <lci:obs TIME_PERIOD="2014-Q1" OBS_VALUE=" " OBS_STATUS="A" CONF_STATUS="F" EMBARGO_TIME=" T14:10:07"/> <lci:obs TIME_PERIOD="2014-Q2" OBS_VALUE=" " OBS_STATUS="A" CONF_STATUS="F" /> </lci:series> </lci:dataset> </CompactData> Examples Examples of SDMX files (DSD version 2.1) are provided for labour cost indices, weights and levels in the document: "Doc 28 - Item SDMX 2.1 for LCI.docx - Annex 2 - test files.7z". Deleted: transmissions IV. TIMETABLE Given the very limited changes caused by the switch from SDMX DSD version 2.0 to SDMX DSD version 2.1, it is proposed to proceed as follows: - Before end of October: countries re-send their LCI data for reference quarter 2017Q2 according to the SDMX DSD version 2.1. SDMX files should be sent to the box ESTAT-LABOUR-COSTS-INDICES and not via edamis. Eurostat validates SDMX files; - Mid-December: countries whose test transmissions have been validated by Eurostat use the SDMX DSD version 2.1 for their regular transmission of LCI data for reference quarter 2017Q3. At that point in time, Eurostat no longer accepts transmissions in SDMX DSD version 1.0; Deleted: format Deleted: standard LAbour MArket Statistics working group 10-11/10/2017 Page 6

7 - Early January 2018, the countries concerned (i.e. AT, DK, ES, FR, HU, NL, RO, CZ) transmit labour cost levels estimates in SDMX (DSD version 2.1) as a test. Eurostat validates their transmission; - By 23 March 2018, the countries concerned (i.e. AT, DK, ES, FR, HU, NL, RO, CZ) transmit labour cost levels estimates up to reference year 2017 in SDMX (DSD version 2.1). - As of April 2018, all LCI weights are transmitted using the SDMX DSD version 2.1. Deleted: format Deleted: Page Break V. PROPOSAL The LAMAS is invited to take note of: - The (limited) changes introduced in SDMX DSD version 2.1 compared with SDMX DSD version 2.0 as regards LCI transmissions (both indices and weights); - The proposal to send test transmissions to Eurostat before the end of October 2017 (forlci) and in January 2018 (for labour cost levels); - The proposal to switch to SDMX DSD version 2.1 in production as from reference quarter 2017Q3 (for LCI) from reference year 2017 (for labour cost levels) and from April 2018 onwards for weights. LAbour MArket Statistics working group 10-11/10/2017 Page 7