FRM4Veg
Although earth observation (EO) data and products are widely available, it is still rare for them to have reliable and fully traceable (ideally to SI) evidence concerning the quality of the retrieved information. Quantitative EO products can be compared against calibrated in situ measurements such as those from reference networks (RadCalNet (CEOS 2019), Aeronet (Holben et al. 1998)), through intensive field campaigns ( BigFoot (Cohen and Justice 1999), VALERI (Baret et al. 2005)), or ecological research networks (TERN (Karan et al. 2016), NEON (Keller et al. 2008)). However, in most cases (excluding RadCalNet) the field campaigns or networks were not implemented with the primary purpose of satellite product validation studies, but rather only to understand local or continental-scale ecological processes and land-atmosphere interactions.
Consistency of measurements of the same parameter taken at individual sites by different teams cannot be guaranteed. So spatial sampling and measurement equipment may differ and operator and post-processing errors are not typically quantified. In addition, the array of satellite-derived data products being validated are often created with multiple sources of EO data using different retrieval algorithms and assumptions. These confounding issues mean that estimating a meaningful bias between the in situ ’validation‘ measurements and the satellite observations is challenging.
Reliable compliance information of quantitative EO products will become even more critical as satellite-derived data are increasingly driving the information and knowledge required for decision making. Compliance and quality information will serve to solve issues that may arise around:
1. regulatory initiatives
2. liability debates between customers and providers of value-added (quantitative) EO products and services
3. auditing efforts and/or contractual negotiations for the operational exploitation of EO data (Widlowski 2015).
Irrespective of context, the conformity of a data product can only be established with respect to permissible deviations from an agreed reference, eitherin situ or drone-based estimate of the satellite derived variable. Ideally this reference should be SI traceable,or community agreed, and the uncertainty of the reference will be smaller than that of the candidate item. While these considerations are an integral part of conformity testing in metrology, they are not yet included in validation efforts of satellite-derived quantitative surface information (Widlowski 2015).
In simple terms, the ESA sponsored Fiducial Reference Measurement (FRM) programme aims to provide a suite of reference measurements (of land, ocean and atmosphere variables) with an associated uncertainty that can be used to conduct satellite product validation through conformity testing. That is, the process that determines whether the estimated target quantity (i.e. the satellite estimate) falls within the range of tolerable values (i.e. the reference estimate), or not.
Further, FRM4Veg will develop the methods and guidance documentation which should be followed by the international validation community when a) collecting both campaign and permanent FRMs, and b) performing validation of satellite derived products, over the vegetated land surface.
All FRMs should:
1. Have documented SI traceability (or conform to appropriate international community standards), utilising instruments that have been characterised using metrological standards, both pre-deployment and evaluated regularly post-deployment (Fox and Greening 2010, Theocharous et al. 2010).
2. Be independent from the satellite geophysical retrieval process.
3. Be accompanied by an uncertainty budget for all instruments, derived measurements and validation methods (JGCM-100 2008).
4. Adhere to community-agreed, published and openly-available measurement protocols/ procedures and management practices. 5. Be accessible to other researchers allowing independent verification of processing systems.
FRM4Veg field sites include: Wytham Woods, UK and Barrax – Las Tiesas, Spain
Additional field sites are being considered for FRM4Veg phase 2 that will commence in 2020.