IS-ENES2 Key Performance Indicators

Transcription

1 3rd KPI Report April September 2016 Project Objectives: 1 - Foster the integration of the European Climate and Earth system modelling community 2 - Enhance the development of Earth System Models for the understanding of climate variability and change 3 - Support high-end simulations enabling to better understand and predict future climate change The current update of these indicators reflects the state of the infrastructure as of September They are presented according to the four project objectives. They have been designed in order to deliver significant figures on the progress of the infrastructure every 6 months. Some indicators are proposed in cumulative form. For those indicators that are provided at monthly resolution, we show, based on data availability, the values from the start of the project to give information on the history of the infrastructure. NB: the ENES data federation established and maintained by IS-ENES is part of the international Earth System Grid Federation (ESGF). ESGF, after a major security issue ocurred in summer 2015, was down from June 2015 to January 2016 and ever since is working partially as the set of data nodes were put into operation gradually. The time series of certain model data related performance indicators might therefore be incomplete in the period from on. 1 - Foster the integration of the European Climate and Earth system modelling community Involvment of external parties in project workshops Assessing events' degree of openess and feedback from recipient community Percentage of external attendees/contributors to project workshops since the start of the project. Are not included internal working sessions. Related Project Objective 1 Related Project activity/ies A ll WPs Responsible Partner CNRS-IPSL I nformation from workshops attendance lists Manual analysis of attendance lists. Cumulated indicator from the start of the project ( ). Limitations (if any) n/a 1/10

2 2 - Enhance the development of Earth System Models for the understanding of climate variability and change Secondary objective: 3 - Support high-end simulations enabling to better understand and predict future climate change (for OASIS3-MCT which is optimised for parallel HPC) Number of OASIS/CDO/NEMO downloads Number Related Project Objective 2, 3 Related Project activity/ies WP7 T3 &T4 Responsible Partner CERFACS/MPG/CNRS-IPSL Number of software downloads from OASIS/CDO/NEMO websites OASIS download page ( CDO download page ( NEMO download page ( ocean.eu/using-nemo/user-guides/basics/nemo-quick- Start-Guide) Acquisition of data from the OASIS/CDO/NEMO download sites. Limitations (if any) Figures are only available since March /10

3 2 - Enhance the development of Earth System Models for the understanding of climate variability and change Secondary objective: 3 - Support high-end simulations enabling to better understand and predict future climate change (for OASIS3-MCT which is optimised for parallel HPC) Number of discussions on OASIS/CDO/NEMO forums and number of mails exchanged on OASIS/CDO/NEMO support or user mailing list Number of threads and number of exchanges for each thread on OASIS/CDO/NEMO forum, plus number of mails exchanged on the OASIS/CDO/NEMO support or user mailing list Number Related Project Objective 2, 3 Related Project activity/ies WP7 T3 & T4 Responsible Partner CERFACS/MPG/CNRS-IPSL OASIS forum: and OASIS user mailing list ; CDO forum: NEMO forum: and NEMO mailing lists (NEMO System Team and NEMO users). Acquisition of data from the OASIS/CDO/NEMO forum and from the OASIS/NEMO mailing list statistics Limitations (if any) Figures are only available since March /10

4 2 - Enhance the development of Earth System Models for the understanding of climate variability and change Secondary objective: 3 - Support high-end simulations enabling to better understand and predict future climate change (for OASIS3-MCT which is optimised for parallel HPC) Number of tickets opened and closed in OASIS/CDO/NEMO project management system Number of tickets opened and closed in OASIS/CDO/NEMO project management system Number Related Project Objective 2, 3 Related Project activity/ies WP7 T3 & T4 Responsible Partner CERFACS/MPG/CNRS-IPSL OASIS Redmine site: ; CDO Redmine site: ; NEMO Trac system: Acquisition of data from the OASIS/CDO/NEMO project management system Limitations (if any) Figures are only available since March /10

5 Regarding the following 3 KPIs: the ENES data federation established and maintained by IS-ENES is part of the international Earth System Grid Federation (ESGF), which in June 2015 was driven down for security reasons until mid of January All components of the ESGF software were completely reconditioned, partly rebuilt and extensively tested. Here the first step focused on the core functionalities for data distribution. The dashboard software is part of the second overhaul step which is ongoing now (as of ). As all new software undergoes strict security checks by NASA, the dashboard software is not yet operational (our source of the statistics raw data). In addition, during the downtime many sites changed names and layout of their data nodes. Now, only 2 ENES nodes are missing (CMCC and UNICAN) and one has been transferred to a non-esgf data distribution system. Only seven of the 18 ENES data nodes (BADC 2, CEA, CNRM, DMI, ICHEC, SMHI; see table below) are up in a comparable configuration as before the overhaul. Since the dahsboard is not yet available, statistics on Data Node Usage (downloads by transactions & volume; sum of users) are, as of November 2016, not available, and will be evaluated again as soon as the new secure dashboard version is operational. Statistics on user support via mailing list on the other hand are continuously possible and are given in the tables below: (#/% of user query threads). Since the restart of ESGF, the CMIP5 download from CERA which was extensively used during the downtime of ESGF (between June 2015 and January 2016), has decreased. Even if some nodes are still down, the replicas available through ESGF allow to recover a lot of data (e.g. all CMIP5 output1 data). 5/10

6 Model data download volumes Volume per month of data successfully downloaded through the ESGF data nodes belonging to IS-ENES. GB/month, for all projects (CMIP5, CORDEX and few Related Project Objective 4 Related Project activity/ies SA2 / T1 Responsible Partner DKRZ (SA2 WPL) Statistics information collected in distributed data node databases by script/dashboard application [Data from 07/2015 to 09/2016 not available. See remarks above] Limitations (if any) Volume per month computed since the start of the project. EU and outside EU users are counted separately. WDCC data node statistics is added separately since it uses a different statistics script (long-term archive which is Oracle and tape-based). Users from EU and outside EU cannot be distinguished at wdcc-esgf.dkrz.de. Replications done by ESGF staffs cannot be distinguished from user activities and are counted; error ~ 10% since the query results may depend on the logging; Fluctuations by replications and power user activities. - June 2015-January2016: ESGF downtime - January 2016-March 2016: partial start of ESGF nodes - April 2016-September 2016 : nearly all ESGF nodes working (at that time still 3 ENES [10 global] missing) - but no monitoring possible due to delayed check of dashboard software. 6/10

7 Model data file downloads Number of downloaded files per month from all IS-ENES data nodes. Repetitions are counted, if files are multiply downloaded from one node. 1/month, for all projects (CMIP5, CORDEX and few others) Related Project Objective 4 Related Project activity/ies SA2 / T1 Responsible Partner DKRZ (SA2 WPL) Statistics information collected in distributed data node databases by script/dashboard application [Data from 07/2015 to 09/2016 not available. See remarks above] Limitations (if any) File numbers per month computed since the start of the project. Users from EU and outside EU are distinguished. Node wdcc-esgf.dkrz.de could not be included until now (no file numbers available), tool is in progress; error ~ 10 % since the query results may depend on the logging; fluctuations: replications and power user activities are count. - June 2015-January 2016 : ESGF downtime - January 2016-March 2016: partial start of ESGF nodes - April 2016-September 2016 : nearly all ESGF nodes working (at that time still 3 ENES [10 global] missing) - but no monitoring possible due to delayed check of dashboard software. 7/10

8 Active users per data node Sum of active users per month over all IS-ENES data nodes. Counted are users who successfully downloaded a file from an ESGF data node belonging to IS-ENES. 1/month Related Project Objective 4 Related Project activity/ies SA2 / T1 Responsible Partner DKRZ (SA2 WPL) Statistics information collected in distributed data node databases by script/dashboard application Users from single node data have been summed to get an estimate of IS-ENES total.eu and non-eu users are counted separately. Information since start of the [Data from 07/2015 to 09/2016 not available. See remarks above] Limitations (if any) Users that accessed various data nodes cause multiple counts; reversely some active users serve a large community of users in their institution. - June 2015-January 2016: ESGF downtime - January 2016-March 2016: partial start of ESGF nodes - April 2016-September 2016 : nearly all ESGF nodes working (at that time still 3 ENES [10 global] missing) - but no monitoring possible due to delayed check of dashboard software. 8/10

9 Number of answers to user queries with IS-ENES contribution Number/percentage of reply threads to international ESGF user queries to which IS-ENES partners have contributed. 1/month Related Project Objective 4 Related Project activity/ies SA2 / T1 Responsible Partner DKRZ (SA2 WPL) Information from [esgf-user] mailing list Manual evalution of support mailing list. Limitations (if any) Few answers of non-enes Europeans may be included. 9/10

10 Statistics for use of the Climate4impact portal Number of visitors to the climate4impact (C4I) website. Added are related information on pages, hits and Bytes to inform on type of visit. number, bytes (monthly average since January 2015) Related Project Objective 4 Related Project activity/ies SA2 / T3 Responsible Partner KNMI AWStats In addition to people just having a look, the number of visitors shows also the people searching and downloading data from ESGF or browsing through the documentation. - Using apache log files and AWStat for the user statistics; AWstats takes care of excluding bots etc. Limitations (if any) The statistics of C4I only started in January /10