QWG7 Payload data Ground segment Status

Transcription

1 QWG7 Payload data Ground segment Status D. Clarijs 03/05/2018 VITO Remote sensing

2 Presentation outline Data reception Processing Action items Product distribution PR & Activities

3 Presentation outline Data reception Processing Action items Product distribution PR & Activities

4 Decompression errors since start of mission 25 April 2018 Primary lane Secundary lane

5 MMM overwrites in January 2018 Problem: Memory overwrites during 2 Redu overpasses Stable Antarctica acquisitions Data increasing in N latitudes No x-band downlink Solution: # Antarctica acquisitions decreased since 1 Feb 2018 IPC tool memory budget threshold adapted Make memory overwrites visible?

6 Presentation outline Data reception Processing Action items Product distribution PR & Activities

7 Data timeliness segments (1 Nov 2017 April 2018)

8 Data timeliness 1 km products (1 Nov 2017 April 2018)

9 Data timeliness 300 m products (1 Nov 2017 April 2018)

10 Data timeliness 100 m products (1 Nov 2017 April 2018)

11 Data timeliness, average delivery time (1 Nov 2017 April 2018)

12 System infrastructure availibility (1 Nov 2017 April 2018) Nominal production infra (132 Ph machines) Category Pct uptime Category MEP Infra (106 Ph machines) Pct uptime Switches 100% Database servers 99.94% Mid Term File Servers 99.95% Short Term File Servers 99.95% Master Servers 99.95% Worker Nodes 99.94% PDF 99.97% Ceph Storage 99.95% OS Compute nodes 96.94% OS Controller nodes 99.94% Database servers 99.91% Hadoop servers 98.98% User VMs (# = 114) 99.43% Other servers 99.95% Includes planned downtime/upgrades. Old servers are phased out and replaced

13 Presentation outline Data reception Processing Action items Product distribution PR & Activities

14 AI6.4 Antarctica acquisition VITO to continue investigation on the acquisition of Antarctica data within the nominal processing chain and update integration time matrix with support from QinetiQ Antarctica acquisitions from 24/10/2017 to 27/02/2018 Using calibration segments Separate workflow and machines were setup using other DEM and polar stereographic projection; Manual processing 1137 segments in 100 m, 3387 for 300 m/1 km Accesible using PDF, User VM and Jupyter Notebooks Qinetiq (ESTEC approved) is working on a fix that enables the possibility to define separate integration times for the Antarctica continent. This would allow processing these segments in nominal production in a following season.

15 AI6.4 Antarctica acquisition product distribution

16 AI6.5 Antarctica acquisition Inform community 30/11/ /03/2018 Updated for Antarctica data

17 AI6.7 planning for next yaw manoeuvre Question has been asked to Qinetiq to do a proposal for the June/July 2018 timeframe. This request needs to be confirmed by ESA in order to start Qinetiq s preparation.

18 AI6.13 Compositing period for the BRDF-corrected products No need from the CGLS to have BRDF corrected products. Have their own BRDF correction for 2 products (20-day compositing for 300 m products, 30 day for 1 km) Trade-off needed: NRT change detection: short compositing period needed, but no optimal results Compositing over longer time periods: the more observations, the better, but info needs to be relevant When computing over different sensors (time series), best to keep de preprocessing in hands of service that produces derived products MODIS uses 16 days compositing period

19 AI6.13 Compositing period for the BRDF-corrected products No need as they take care of BRDF correction (MeteoFR). 20-day compositing for their TOC Albedo product No interest in 300 m or higher resolution products, only 1 km Department of Remote Sensing of the Capital of Budapest Would be useful; 5 day composite would be nice Other high profile land users user contacted, but no answers received up until now

20 Presentation outline Data reception Processing Action items Product distribution PR & Activities

21 PROBA-V Evolution user registrations Period October 15, 2013 April 24, 2018 Active users registered via portal: different institutions 115 different nationalities

22 PROBA-V Evolution user registrations Period October 15, 2013 November 1st, 2017 Active users registered via portal

23 Geographical spread of PROBA-V users Spread of users on 26th April 2018 User growth since QWG #6 (Nov 2017) % % 11% % % 0% 36

24 # users per country spread over the world: start 23 April 2018

25 Top 20 user companies 1 Nov April 2018

26 VITO Data use 1 Nov April 2018 Copernicus 761 Guest user registratie 266 MARS 192 MESA training program 140 PoD 846 Quality Check 224 Special Images 815 Test/Maintenance 246 Grand Total 3490 Special Images 23% Quality Check 6% Test/Mainte nance 7% PoD 24% Copernicus 22% Guest user registratie 8% MARS 6% MESA training program 4% Active registered users: 2856 (+110/month) Eumetcast reach: 645 registered users

27 Top 20 countries with most product deliveries 1 Nov April 2018

28 # deliveries per country 1 Nov april 2018

29 Amount of downloaded products Period 1 Nov April 2018 Since start of mission 25 April 2018

30 Data download/product in GB: 1 Nov April 2018

31 MEP application statistics 1 Nov April 2018 N-Daily compositor 187 jobs executed 272 page views 53 users Geo Viewer 675 sessions 551 users 267 new users User Virtual Machines 114 unique users 22 new users Time Series Viewer 1116 page views 389 users 181 new users

32 Platforms giving access to PROBA-V data

33 Presentation outline Data reception Processing Action items Product distribution PR & Activities

34 PDGS activities Upgrade of distribution portal ( Database optimization Upgrade of outdated libraries Move to HTTPS Release of OpenSearch interface

35 PDGS MEP activities Final contract stage: No new functionalities Focussed on lowering the bar for users Bug fixes and performance improvements Forum to be released Acceptance of the MEP TPS projects

36 PROBA-V & Education

37 Mailings Social media

38 PR

39 PROBA-V Symposium

40 THANK YOU Sentinel-2 image Copernicus Sentinel data (2016)