LY OPERATIONS REPORT MOR#02 Reporting period from 6-Aug-205 to 5-Sep-205 Reference: PROBA-V_D5_MOR-02_205-09_v.0 Author(s): Erwin Wolters, Dennis Clarijs, Sindy Sterckx, Flip Boonen Version:.0 Date: 8/09/205
Contract No. 400029/4/I-LG - 3074 DOCUMENT CONTROL Signatures Author(s) Erwin Wolters, Dennis Clarijs, Sindy Sterckx, Flip Boonen Reviewer(s) Dennis Clarijs Approver(s) Dennis Clarijs Issuing authority Change record Release Date Pages Description Editor(s)/Reviewer(s).0 8/09/205 All Initial version PROBA-V_D5_MOR-02_205-09_v.0 Monthly Operations Report Page 2 of 9
Contract No. 400029/4/I-LG - 3074 TABLE OF CONTENT. Summary... 4 2. System Infrastructure... 4 3. Image Processing Services... 5 3.. Ingested and archived products... 5 3.2. Generated and archived products... 5 3.3. Backup and archiving service... 6 3.4. Dissemination service... 7 3.5. End-user activity... 7 4. Image Calibration services... 0 4.. Radiometric Calibration... 0 4.2. Geometric Calibration... 5 5. Anomalies... 7 5.. System related issues... 7 5.2. Image processing issues... 8 6. Scheduled activities for the next period(s)... 9 7. Operational remarks... 9 PROBA-V_D5_MOR-02_205-09_v.0 Monthly Operations Report Page 3 of 9
Contract No. 400029/4/I-LG - 3074. Summary In the past month, nearly all syntheses were complete. We still do experience a handful of decompression errors on a daily basis, but the impact is minimized since the last update of the DIF processing component. One synthesis shows a large gap, four a medium gap; all other syntheses have negligible gaps. In this reporting period, no transfer frame files were missing. An update of the Processing Facility component was released in this reporting period. This upgrade minimizes the amount of data discarded if there are inaccurate quaternion values. These could cause large pixel displacements, typically occurring when the platform is not yet stable from a platform manoeuvre. On 28/08/205, the public release of the geotiff format was announced. In the past 3 months, VITO has generated the GeoTIFF format for all products in all resolutions on disk for period July 204 up until now. Also, a new release of the PDF distribution portal was released on 5/09/205, which included some bug fixes and the INSPIRE compliancy of the PROBA-V metadata. Furthermore, a new release of the PF module is planned in order to generate the daily % of missing pixels for each product. This percentage will be embedded in future reporting. There were no issues with the image quality during this reporting period, both for radiometric as geometric quality. 2. System Infrastructure Category % Up Time % Down Time (*) Switches 00.0 0.0 Database Servers 00.0 0.0 Mid Term File Servers 00.0 0.0 Short Term File Servers 99.99 0.0 Master Servers 00.0 0.0 Worker Nodes 99.86 0.4 PDF 00.0 0.0 Table : System Infrastructure availability for this reporting period (*) PSTFS5, PNODE5, PNODE8: scheduled downtime due to maintenance; no impact on production PROBA-V_D5_MOR-02_205-09_v.0 Monthly Operations Report Page 4 of 9
Contract No. 400029/4/I-LG - 3074 3. Image Processing Services 3.. Ingested and archived products Product Type Total Received Missing data, Archived ingested by VITO METEO 248 248 248 TFF 3 3 0 3 Table 2: Ingested and archived products for this reporting period 3.2. Generated and archived products Product Type Total Processed Error Archived PROBAV_LA - Calibration 477 477 477 PROBAV_LA - Nominal 2626 2620 7 (*) 2625 PROBAV_LC 2620 2620 2620 PROBAV_L3_S_TOA_00M 3 3 3 PROBAV_L3_S_TOC_00M 3 3 3 PROBAV_L3_S_TOC_NDVI_00M 3 3 3 PROBAV_L3_S5_TOA_00M 6 6 6 PROBAV_L3_S5_TOC_00M 6 6 6 PROBAV_L3_S5_TOC_NDVI_00M 6 6 6 PROBAV_L3_S_TOA_300M 3 3 3 PROBAV_L3_S_TOC_300M 3 3 3 PROBAV_L3_S0_TOC_300M 3 3 3 PROBAV_L3_S0_TOC_NDVI_300M 3 3 3 PROBAV_L3_S_TOA_KM 3 3 3 PROBAV_L3_S_TOC_KM 3 3 3 PROBAV_L3_S0_TOC_KM 3 3 3 PROBAV_L3_S0_TOC_NDVI_KM 3 3 3 Table 3: Generated and archived products for this reporting period (*) x LA decompression error 4 x LA missing data on synthesis (pixel shift) 2 x missing data on synthesis due to automatic recovery PROBA-V_D5_MOR-02_205-09_v.0 Monthly Operations Report Page 5 of 9
Contract No. 400029/4/I-LG - 3074 3.3. Backup and archiving service Product type Total Files Total File Size (GB) TFF 38 868.9 LA 2827 428.53 Database transaction logs 82 77.36 Database incremental back-up 80 27.53 Database full back-up 40 652.4 Table 4: Back-up data volumes for this reporting period Product type Total Files Total File Size (GB) PROBAV_TRANSFERFRAMES 292 859.82 PROBAV_LA 2906 534.8 PROBAV_LC 2462 2885.26 PROBAV_L3_S_TOA_00M 29 73.85 PROBAV_L3_S_TOC_00M 29 763.88 PROBAV_L3_S_TOC_NDVI_00M 29 90.86 PROBAV_L3_S5_TOA_00M 6 560.69 PROBAV_L3_S5_TOC_00M 6 585.52 PROBAV_L3_S5_TOC_NDVI_00M 6 66.34 PROBAV_L3_S_TOA_300M 29 329.98 PROBAV_L3_S_TOC_300M 29 344.0 PROBAV_L3_S0_TOC_300M 3 68.8 PROBAV_L3_S0_TOC_NDVI_300M 3 5.37 PROBAV_L3_S_TOA_KM 29 48.54 PROBAV_L3_S_TOC_KM 29 50.08 PROBAV_L3_S0_TOC_KM 3 9.52 PROBAV_L3_S0_TOC_NDVI_KM 3 0.70 ICP_GEOMETRIC_CENTRE ICP_ GEOMETRIC _LEFT ICP_ GEOMETRIC _RIGHT ICP_RADIOMETRIC_CENTRE 0.04 ICP_RADIOMETRIC_LEFT 0.04 ICP_RADIOMETRIC_RIGHT 0.04 METEO_ECMWF 232 0.29 METEO_METEOSERVICES 232.24 POLARMOTION 0.00 Table 5: Archived data volumes for this reporting period PROBA-V_D5_MOR-02_205-09_v.0 Monthly Operations Report Page 6 of 9
Contract No. 400029/4/I-LG - 3074 3.4. Dissemination service Product type Added to catalogue Ordered Delivered PROBAV_LC 266 29 35 PROBAV_L3_S_TOA_00M 32 584 325 PROBAV_L3_S_TOC_00M 3 308 269 PROBAV_L3_S_TOC_NDVI_00M 3 505 30 PROBAV_L3_S5_TOA_00M 8 87 90 PROBAV_L3_S5_TOC_00M 67 632 75 PROBAV_L3_S5_TOC_NDVI_00M 6 572 595 PROBAV_L3_S_TOA_300M 3 25 27 PROBAV_L3_S_TOC_300M 3 880 873 PROBAV_L3_S0_TOC_300M 3 28 36 PROBAV_L3_S0_TOC_NDVI_300M 3 287 33 PROBAV_L3_S_TOA_KM 3 03 0 PROBAV_L3_S_TOC_KM 3 96 203 PROBAV_L3_S0_TOC_KM 3 26 28 PROBAV_L3_S0_TOC_NDVI_KM 3 22 233 Table 6: Ordered and delivered products for this reporting period 3.5. End-user activity 22 new user(s) were registered in this reporting period. The total number of users registered for PROBA-V data and that have ordered data is 545 with 88 different nationalities representing 439 different companies/universities. Product type Africa Asia Europe N-America Oceania S-America PROBAV_LC 326.96 PROBAV_L3_S_TOA_00M 30.5 4.5 PROBAV_L3_S_TOC_00M 8.48 PROBAV_L3_S_TOC_NDVI_00M 9.08 7.72 2.44 0.03 PROBAV_L3_S5_TOA_00M 03.57 5.52 PROBAV_L3_S5_TOC_00M 0.02 63.67 4442.82 346.8 20.3 PROBAV_L3_S5_TOC_NDVI_00M 00.54 6.56.2 PROBAV_L3_S_TOA_300M 735.4 PROBAV_L3_S_TOC_300M 832.66 0.02 PROBAV_L3_S0_TOC_300M.92.04 33.56 PROBAV_L3_S0_TOC_NDVI_300M 0.0 6.74.72 0.6 PROBAV_L3_S_TOA_KM 0.08 06.02 PROBA-V_D5_MOR-02_205-09_v.0 Monthly Operations Report Page 7 of 9
Contract No. 400029/4/I-LG - 3074 PROBAV_L3_S_TOC_KM 0.00 255.94 0.03 PROBAV_L3_S0_TOC_KM 0.84.78 20.78 8.87 PROBAV_L3_S0_TOC_NDVI_KM 0.0.2 2.06 0.22 Table 7: Data download (GB) in total per Origin of the User for the reporting period Product Type Global LC 326.96 PROBAV_L3_S_TOA_00M 7.30 PROBAV_L3_S_TOC_00M 83.93 PROBAV_L3_S_TOC_NDVI_00M 29.27 PROBAV_L3_S5_TOA_00M 20.00 PROBAV_L3_S5_TOC_00M 62.2 PROBAV_L3_S5_TOC_NDVI_00M 08.22 PROBAV_L3_S_TOA_300M 735.4 PROBAV_L3_S_TOC_300M 832.68 PROBAV_L3_S0_TOC_300M 36.5 PROBAV_L3_S0_TOC_NDVI_300M 8.63 PROBAV_L3_S_TOA_KM 06.0 PROBAV_L3_S_TOC_KM 255.98 PROBAV_L3_S0_TOC_KM 42.26 PROBAV_L3_S0_TOC_NDVI_KM 3.49 Table 8: Data download (GB) in total for the reporting period Company # of downloaded products VITO 343 zrc 297 Consorzio LaMMA 607 Nagoya University 574 GEUS, Geological Survey of Denmark and Greenland 488 Armstatehydromet 465 University of Leicester 464 NCU 356 IGiK 267 International Water Management Institute 28 Table 9: Top 0 user companies for the reporting period PROBA-V_D5_MOR-02_205-09_v.0 Monthly Operations Report Page 8 of 9
Contract No. 400029/4/I-LG - 3074 Company # of registered users BELGIUM 56 CHINA 4 ITALY 29 FRANCE 24 UNITED STATES 23 BRAZIL 23 NETHERLANDS 22 UNITED KINGDOM 22 INDIA 7 ARGENTINA 7 Table 0: Top 0 countries with most registered users List of issues raised by users: ProbaV - Quotation for PROBA-V images - List of quality issues PROBA-V - PROBA-V Geotiff in SPIRITS - Question on 00 m TOC NDVI products - Data format of Copernicus delivery - NDVI data - S5 data for different region? PDF portal - User registration PDF? - Forgot username and password - Order status? - Delete PDF account - PDF question on ordered files - PDF: login details - massive order not delivered - No access to the PDF - Password lost PROBA-V_D5_MOR-02_205-09_v.0 Monthly Operations Report Page 9 of 9
Contract No. 400029/4/I-LG - 3074 4. Image Calibration services 4.. Radiometric Calibration Calibration request type Total Processed Not received Error CLOUDS 7 6 0 DARK CURRENT 23 2 2 0 MOON 2 2 0 0 RAYLEIGH 52 49 2 SNOW 6 6 0 0 SUN_GLINT 68 68 0 0 Table : Calibration Image requests for this reporting period Calibration image type Total Valid Invalid PROBA_V_LA_CALIBRATION 2 2 PROBA-V_LB_CALIBRATION 475 263 40 PROBA-V_LB_INTERSECTION 676 48 95 PROBA-V_LB_OVERLAPREGION Table 2: Processed calibration images for this reporting period (*) Due to insufficient overlap with the calibration region of interest, not enough pixels (e.g. clouds contamination), site not sufficiently uniform (illumination), etc. Long-term monthly Libya-4 mean plots for different cameras are given in Figure, Figure 2 and Figure 3. Deep convective clouds interband calibration results are given in Figure 4. For all SWIR strips (except for Right SWIR 3, which was updated with 2.8 % in February 205) a decreasing trend in the observed radiances is visible in the Libya-4 results. In order to reduce uncertainties in proposed updates for the absolute calibration coefficients for the different SWIR strips, a trend analysis was also performed on desert calibration results obtained over seven different desert sites i.e. Libya, Libya2, Libya3, Libya4, Niger, Niger2 and Niger3. The median % decrease over all these desert sites was used to determine the % percentage update for the absolute calibration parameters. These are listed in Table 3. Strip A left swir -.7 left swir2 -.9 leftswir3 - center swir -.4 PROBA-V_D5_MOR-02_205-09_v.0 Monthly Operations Report Page 0 of 9
Contract No. 400029/4/I-LG - 3074 center swir2 -.3 center swir3 -.3 right swir -.8 right swir2* -2.3 right swir3 NA *median decrease of 3.3 % observed mid-august, considering the % update on 26 August 205, the remaining update is 2.3 % Table 3 Absolute calibration coefficients updates SWIR strips In order to prevent stepwise updates in the future it will be analyzed in the coming months if a degradation model can be set-up for the different strips based on all the results obtained. Vignetting analysis on the different SWIR strips have been set-up over a set of desert sites. Preliminary results indicate some slight strip non-uniformity at the edge of the Center SWIR3, Left SWIR3, Left SWIR2, Left SWIR and Right SWIR strip and at the center of Right SWIR and Center SWIR3. These non-uniformities are small (< 3 %). The exact quantification of the non-uniformities and the retrieval of equalization coefficients to correct for it, requires some further analysis in order to properly discriminate between instrument induced non-uniformities and BRDF or site related effects. Radiometric ICP file ICP SWIR dark values will be updated in the coming days and the absolute calibration coefficient of the different SWIR strips as listed in listed in Table3. The current ICP files are: PROBAV_ICP_RADIOMETRIC#LEFT_2050826_V0 PROBAV_ICP_RADIOMETRIC#CENTER_ 2050826_V0 PROBAV_ICP_RADIOMETRIC#RIGHT_ 2050826_V0 PROBA-V_D5_MOR-02_205-09_v.0 Monthly Operations Report Page of 9
Monthly Operations Report Contract No. 400029/4/I-LG - 3074 LEFT BLUE..08.06.04.02 2 june aug oct dec feb april june aug oct dec feb apr jun aug LEFT SWIR..08.06.04.02 2 june aug oct dec feb apri june aug oct dec feb apr jun aug LEFT RED..08.06.04.02 2 june aug oct dec feb april june aug oct dec feb apr jun aug LEFT NIR..08.06.04.02 2 june aug oct dec feb april june aug oct dec feb apr jun aug LEFT SWIR2..08.06.04.02 2 LEFT SWIR3..08.06.04.02 2 Figure. Libya-4 desert calibration results: LEFT monthly averaged results PROBA-V_D5_MOR-02_205-09_v.0 Monthly Operations Report Page 2 of 9
Monthly Operations Report Contract No. 400029/4/I-LG - 3074 RED CENTER..08.06.04.02 2 june aug okt dec feb apr june aug oct dec feb apr jun aug SWIR CENTER..08.06.04.02 2 RED CENTER..08.06.04.02 2 SWIR2 CENTER..08.06.04.02 2 june aug okt dec feb apr jun aug oct dec feb apr jun aug NIR CENTER..08.06.04.02 2 SWIR3 CENTER..08.06.04.02 2 june aug okt dec feb apr jun aug oct dec feb apr jun aug Figure 2. Libya-4 desert calibration results: CENTER monthly averaged results PROBA-V_D5_MOR-02_205-09_v.0 Monthly Operations Report Page 3 of 9
Monthly Operations Report Contract No. 400029/4/I-LG - 3074 BLUE RIGHT..08.06.04.02 2 SWIR RIGHT..08.06.04.02 2 RED RIGHT..08.06.04.02 2 SWIR2 RIGHT..08.06.04.02 2 NIR RIGHT..08.06.04.02 2 SWIR3 RIGHT..08.06.04.02 2 Figure 3. Libya-4 desert calibration results: RIGHT monthly averaged results PROBA-V_D5_MOR-02_205-09_v.0 Monthly Operations Report Page 4 of 9
Contract No. 400029/4/I-LG - 3074 Figure 4. DCC inter-band calibration results: LEFT, CENTER and RIGHT camera 4.2. Geometric Calibration Calibration image type Total Processed Error PROBA-V_LC_INTERSECTION 4202 4202 Table 4: Processed calibration images for this reporting period During the previous month, the average ALE was < 64 m (σ < 77 m). Figure X shows an increasing trend, from just below 50 m at 6/8 to ~65 m at 5/9. On top of this trend, two peak periods occurred with values of 82 m (/9) and 78 m (7/9). The daily standard deviation values increased rather sharply from 45 50 m (5/8 20/8) to generally 70 75 m in the remaining period. The cause of this increase is currently being investigated. The geometric accuracy was within the requirement of < 300 m, with an average compliance of > 99.3%. Daily values were > 99.7% for all channels from 6/8 20/8. From 2/8 onwards, daily values decreased. Especially for the BLUE, RED, and NIR channels, values became well below 99.5% (minimum value 98.9% at 7/9 for the BLUE channel). The SWIR channel remained stable at values around 99.8%. Geometric ICP file PROBA-V_D5_MOR-02_205-09_v.0 Monthly Operations Report Page 5 of 9
Contract No. 400029/4/I-LG - 3074 The current ICP files are: PROBAV_ICP_GEOMETRIC#LEFT_2050709_V0 PROBAV_ICP_GEOMETRIC#CENTER_2050709_V0 PROBAV_ICP_GEOMETRIC#RIGHT_2050709_V0 Figure 5 Overview of daily absolute location error of this reporting period PROBA-V_D5_MOR-02_205-09_v.0 Monthly Operations Report Page 6 of 9
Contract No. 400029/4/I-LG - 3074 5. Anomalies 5.. System related issues A detailed description of each issue is available in the issue tracking system http://jira.vgt.vito.be Key Summary Status Created Component/s PROBAVUS-7 Very small images fail to process Resolved 0/0/204 General 0 new issues were logged during this reporting period 2 issue(s) was resolved and closed during this reporting period 0 issues are resolved but remain to be closed formally issue are resolved but remain in the list logging purposes issue(s) is open and remain to be solved PROBA-V_D5_MOR-02_205-09_v.0 Monthly Operations Report Page 7 of 9
Contract No. 400029/4/I-LG - 3074 5.2. Image processing issues Besides the usual decompression errors, no image processing issues were logged. For all products the geotiff format of the past year has been generated on disk to facilitate fast access to these products using the PDF portal. A detailed description of each issue is available in the Weekly Report and the image processing tracking system https://juniper.vgt.vito.be/ciptools The below table gives an overview of the S s of this reporting period: Major Gaps (> 2600 km² (missing TFF)) 0 # S Dates Large Gaps (< 2600 km²) 2 04/09, 4/09 Medium Gaps (< 0000 km²) 5 5/09, 02/09, 25/08, 24/08, 9/08 Minor Gaps (< 3600 km²) 3/09 Negligible Gaps (< 000 km²) 23 8/08, 07/09, 28/08, 23/08, 2/09, 0/09, 22/08, 7/08, 27/08, 06/09, /09, 2/08, 6/08, 3/08, 26/08, 0/09, 05/09, 09/09, 20/08, 30/08, 29/08, 03/09, 08/09 Complete synthesis (no gaps) 0 Table 5: Overview of S for this reporting period PROBA-V_D5_MOR-02_205-09_v.0 Monthly Operations Report Page 8 of 9
Contract No. 400029/4/I-LG - 3074 6. Scheduled activities for the next period(s) Software upgrades: o An upgrade to the PF component will be done to be able to add the daily missing % of pixels to the reporting. Hardware: o Some servers in the PROBA-V processing chain are end-of-life. An assessment will be done to determine which servers can and will be upgraded. Development: o An improvement of the cloud detection algorithm is under investigation. 7. Operational remarks No operational remarks PROBA-V_D5_MOR-02_205-09_v.0 Monthly Operations Report Page 9 of 9