{"id":1172,"date":"2019-03-26T16:00:50","date_gmt":"2019-03-26T16:00:50","guid":{"rendered":"https:\/\/research.reading.ac.uk\/fiduceo\/?p=1172"},"modified":"2019-07-26T16:54:32","modified_gmt":"2019-07-26T15:54:32","slug":"looking-for-closure","status":"publish","type":"post","link":"https:\/\/research.reading.ac.uk\/fiduceo\/looking-for-closure\/","title":{"rendered":"Looking for closure"},"content":{"rendered":"<p>by <a href=\"https:\/\/www2a.le.ac.uk\/departments\/physics\/research\/eos\/tim-trent\">Tim Trent<\/a><\/p>\r\n<!-- \/wp:post-content -->\r\n\r\n<!-- wp:paragraph -->\r\n<p>When thinking of topics for this blog, I decided to take a reflective approach.\u00a0 Just reviewing past blog entries, the levels of effort and complexity needed in looking for uncertainty closure are apparent to the reader. Furthermore, the project makes a clear case for the importance of why we should care about the uncertainty of the measurements we use. As we enter the last phase of the project, focus is switching towards <a href=\"http:\/\/www.fiduceo.eu\/content\/2nd-fiduceo-workshop-0\">how to apply the FIDUCEO metrological concepts to satellite climate data records<\/a>. This topic is of great significance to international efforts, such as the European Space Agency (ESA) Climate Change Initiative (CCI), that aims to provide quality datasets which realise the potential of global long-term Earth Observation (EO) archives.<\/p>\r\n<!-- \/wp:paragraph -->\r\n\r\n<!-- wp:paragraph -->\r\n<p>With this in mind, this raises the question &#8220;What will the legacy of FIDUCEO be?&#8221; This question will have different answers for different communities and thus is maybe not quite so straight forward. However, perhaps the truth is that it will and should be multifaceted.\u00a0 From my perspective, the common thread that runs through all possibilities is the fully described uncertainty budget estimate. So why do I think this? Whether we study the carbon, nitrogen, water, energy, or any of the environmental cycles, closure of these budgets allows us to improve our understanding of the Earth system. With NASA Decadal survey focusing on process-oriented studies, fully capturing the uncertainty from EO will let us test our knowledge at each step on a global scale.<\/p>\r\n<!-- \/wp:paragraph -->\r\n\r\n<!-- wp:paragraph -->\r\n<p>Uncertainty closure assessment is now becoming a key component in validation studies [1]. Within Water Vapour CCI (WV_cci) total column water vapour (TCWV) products are being assessed against GPS ground-based receivers as part of the retrieval performance assessment. This match-up exercise not only uses the uncertainty from the <em>in situ<\/em>\u00a0 <span class=\"katex-eq\" data-katex-display=\"false\">(m_{2}, u_{2)} <\/span> and satellite products (<span class=\"katex-eq\" data-katex-display=\"false\"> m_{1}, u_{1} <\/span>) ;\u00a0it also includes estimates of the representativeness or collocation uncertainty (<span class=\"katex-eq\" data-katex-display=\"false\">\\sigma <\/span>) in the collocation description. Therefore, in line with the Immler formula [2] the system is described thus:<\/p>\r\n<!-- \/wp:paragraph -->\r\n\r\n<!-- wp:katex\/display-block -->\r\n<p><span class=\"wp-block-katex-display-block katex-eq\" data-katex-display=\"true\">| m_{1} &#8211; m_{2} | &lt; k \\sqrt{(\\sigma^{2} + u_{1}^{2} + u_{2}^{2})} <\/span><\/p>\r\n<!-- \/wp:katex\/display-block -->\r\n\r\n<!-- wp:paragraph -->\r\n<p>( <span class=\"katex-eq\" data-katex-display=\"false\">k <\/span> being the coverage factor, which determines an interval about the mean value as a multiple of the standard uncertainty).<\/p>\r\n<!-- \/wp:paragraph -->\r\n\r\n<!-- wp:paragraph -->\r\n<p>Starting from this point, we can begin to visualise this relationship in such a way that we can determine how well we capture the total uncertainty in the system. The first assumption is that, if fully characterised, then k in the Immler equation is equal to 1. Therefore, this assumption would lead to a 1:1 growth in the standard deviation in the observed differences <span class=\"katex-eq\" data-katex-display=\"false\">(| m_{1} - m_{2} |) <\/span> vs the total uncertainty <span class=\"katex-eq\" data-katex-display=\"false\"> (\\sqrt{(\\sigma^{2} + u_{1}^{2} + u_{2}^{2})}) <\/span> Figure 1 demonstrates this concept for satellite TCWV collected over a SuomiNet GPS site in South America from January 2007 to December 2016.<\/p>\r\n<!-- \/wp:paragraph -->\r\n\r\n<!-- wp:image {\"id\":589,\"width\":447,\"height\":450} -->\r\n<figure class=\"wp-block-image is-resized\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-589\" src=\"https:\/\/research.reading.ac.uk\/fiduceo\/wp-content\/uploads\/sites\/129\/2019\/07\/looking-for-closure-cover-fig-1-1.png\" alt=\"\" width=\"447\" height=\"450\" \/><\/figure>\r\n<!-- \/wp:image -->\r\n\r\n<!-- wp:paragraph -->\r\n<p><em>Figure 1: Example of uncertainty validation based on Immler equation [2]. The black dashed 1:1 line (k=1) is constant below 1 kg\/m<sup>2<\/sup> as this region is limited by the accuracy of the in situ measurement.\u00a0<\/em><\/p>\r\n<!-- \/wp:paragraph -->\r\n\r\n<!-- wp:paragraph -->\r\n<p>The red bands in the top of the figure show the (+\/-) standard deviation as a function of the total uncertainty with the bin densities show in the histogram below. The results at this station look convincing such that we can look at how non-representative collocations affect the scatter in the data with some degree of confidence.<\/p>\r\n<!-- \/wp:paragraph -->\r\n\r\n<!-- wp:image {\"id\":590,\"width\":546,\"height\":521} -->\r\n<figure class=\"wp-block-image is-resized\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-590\" src=\"https:\/\/research.reading.ac.uk\/fiduceo\/wp-content\/uploads\/sites\/129\/2019\/07\/looking-for-closure-cover-fig-2.png\" alt=\"\" width=\"546\" height=\"521\" \/><\/figure>\r\n<!-- \/wp:image -->\r\n\r\n<!-- wp:paragraph -->\r\n<p><em>Figure 2: Impact on scatter due to the non-representativeness of outlying collocated pairs. If we have confidence in our uncertainty budget then we can use this criteria to filter data from our analyses.<\/em><\/p>\r\n<!-- \/wp:paragraph -->\r\n\r\n<!-- wp:paragraph -->\r\n<p>Figure 2 shows four panels that are a function of <span class=\"katex-eq\" data-katex-display=\"false\"> k <\/span> interval. This example demonstrates how the higher the k-value is, the more divergent from the 1:1 (red dashed) line cases become. Now while this may seem intuitive, it allows us to\u00a0examine the breadth of scattering in the match-ups. Thinking of this an iterative methodology, we can look at\/target individual uncertainty components where knowledge gaps present themselves.<\/p>\r\n<!-- \/wp:paragraph -->\r\n\r\n<!-- wp:paragraph -->\r\n<p>It is in this undertaking, where we are looking for closure, that FIDUCEO&#8217;s legacy, the tools and resources of the project will serve us well.<\/p>\r\n<!-- \/wp:paragraph -->\r\n\r\n<!-- wp:paragraph -->\r\n<p>References:<\/p>\r\n<!-- \/wp:paragraph -->\r\n\r\n<!-- wp:paragraph -->\r\n<p>[1] Ghent, D.; Veal, K.; Trent, T.; Dodd, E. and Remedios, J., A new approach to defining uncertainties for MODIS land surface temperature. Remote Sensing, 2019, under review.<\/p>\r\n<!-- \/wp:paragraph -->\r\n\r\n<!-- wp:paragraph -->\r\n<p>[2] Immler, F. J.; Dykema, J.; Gardiner, T.; Whiteman, D. N.; Thorne, P. W. and V\u00f6mel, H., Reference Quality Upper-Air Measurements: guidance for developing GRUAN data products. Atmospheric Measurement Techniques, 2010, 3, 1217\u20131231, doi:10.5194\/amt-3-1217-2010<\/p>","protected":false},"excerpt":{"rendered":"<p>by Tim Trent When thinking of topics for this blog, I decided to take a reflective approach.\u00a0 Just reviewing past blog entries, the levels of effort and complexity needed in&#8230;<a class=\"read-more\" href=\"&#104;&#116;&#116;&#112;&#115;&#58;&#47;&#47;&#114;&#101;&#115;&#101;&#97;&#114;&#99;&#104;&#46;&#114;&#101;&#97;&#100;&#105;&#110;&#103;&#46;&#97;&#99;&#46;&#117;&#107;&#47;&#102;&#105;&#100;&#117;&#99;&#101;&#111;&#47;&#108;&#111;&#111;&#107;&#105;&#110;&#103;&#45;&#102;&#111;&#114;&#45;&#99;&#108;&#111;&#115;&#117;&#114;&#101;&#47;\">Read More ><\/a><\/p>\n","protected":false},"author":219,"featured_media":588,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"__cvm_playback_settings":[],"__cvm_video_id":"","footnotes":""},"categories":[15],"tags":[],"coauthors":[6],"class_list":["post-1172","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-blog"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v21.8.1 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Looking for closure - Fiduceo<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/research.reading.ac.uk\/fiduceo\/looking-for-closure\/\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Looking for closure - Fiduceo\" \/>\n<meta property=\"og:description\" content=\"by Tim Trent When thinking of topics for this blog, I decided to take a reflective approach.\u00a0 Just reviewing past blog entries, the levels of effort and complexity needed in...Read More &gt;\" \/>\n<meta property=\"og:url\" content=\"https:\/\/research.reading.ac.uk\/fiduceo\/looking-for-closure\/\" \/>\n<meta property=\"og:site_name\" content=\"Fiduceo\" \/>\n<meta property=\"article:published_time\" content=\"2019-03-26T16:00:50+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2019-07-26T15:54:32+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/research.reading.ac.uk\/fiduceo\/wp-content\/uploads\/sites\/129\/2019\/07\/looking-for-closure-cover.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"220\" \/>\n\t<meta property=\"og:image:height\" content=\"147\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Alex Daykin\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Alex Daykin\" \/>\n\t<meta name=\"twitter:label2\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/research.reading.ac.uk\/fiduceo\/looking-for-closure\/\",\"url\":\"https:\/\/research.reading.ac.uk\/fiduceo\/looking-for-closure\/\",\"name\":\"Looking for closure - Fiduceo\",\"isPartOf\":{\"@id\":\"https:\/\/research.reading.ac.uk\/fiduceo\/#website\"},\"datePublished\":\"2019-03-26T16:00:50+00:00\",\"dateModified\":\"2019-07-26T15:54:32+00:00\",\"author\":{\"@id\":\"https:\/\/research.reading.ac.uk\/fiduceo\/#\/schema\/person\/532e1ce773445fb76d77785ea76f5be8\"},\"breadcrumb\":{\"@id\":\"https:\/\/research.reading.ac.uk\/fiduceo\/looking-for-closure\/#breadcrumb\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/research.reading.ac.uk\/fiduceo\/looking-for-closure\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/research.reading.ac.uk\/fiduceo\/looking-for-closure\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/research.reading.ac.uk\/fiduceo\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Looking for closure\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/research.reading.ac.uk\/fiduceo\/#website\",\"url\":\"https:\/\/research.reading.ac.uk\/fiduceo\/\",\"name\":\"Fiduceo\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/research.reading.ac.uk\/fiduceo\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-GB\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/research.reading.ac.uk\/fiduceo\/#\/schema\/person\/532e1ce773445fb76d77785ea76f5be8\",\"name\":\"Alex Daykin\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\/\/research.reading.ac.uk\/fiduceo\/#\/schema\/person\/image\/26159086a629d325cff50dd27004d579\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/48d6c4db18e4195997d9ec88cad612357d655264b37576280d9aceae3fa7aac4?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/48d6c4db18e4195997d9ec88cad612357d655264b37576280d9aceae3fa7aac4?s=96&d=mm&r=g\",\"caption\":\"Alex Daykin\"},\"url\":\"https:\/\/research.reading.ac.uk\/fiduceo\/author\/a-j-daykinreading-ac-uk\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Looking for closure - Fiduceo","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/research.reading.ac.uk\/fiduceo\/looking-for-closure\/","og_locale":"en_GB","og_type":"article","og_title":"Looking for closure - Fiduceo","og_description":"by Tim Trent When thinking of topics for this blog, I decided to take a reflective approach.\u00a0 Just reviewing past blog entries, the levels of effort and complexity needed in...Read More >","og_url":"https:\/\/research.reading.ac.uk\/fiduceo\/looking-for-closure\/","og_site_name":"Fiduceo","article_published_time":"2019-03-26T16:00:50+00:00","article_modified_time":"2019-07-26T15:54:32+00:00","og_image":[{"width":220,"height":147,"url":"https:\/\/research.reading.ac.uk\/fiduceo\/wp-content\/uploads\/sites\/129\/2019\/07\/looking-for-closure-cover.jpg","type":"image\/jpeg"}],"author":"Alex Daykin","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Alex Daykin","Estimated reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/research.reading.ac.uk\/fiduceo\/looking-for-closure\/","url":"https:\/\/research.reading.ac.uk\/fiduceo\/looking-for-closure\/","name":"Looking for closure - Fiduceo","isPartOf":{"@id":"https:\/\/research.reading.ac.uk\/fiduceo\/#website"},"datePublished":"2019-03-26T16:00:50+00:00","dateModified":"2019-07-26T15:54:32+00:00","author":{"@id":"https:\/\/research.reading.ac.uk\/fiduceo\/#\/schema\/person\/532e1ce773445fb76d77785ea76f5be8"},"breadcrumb":{"@id":"https:\/\/research.reading.ac.uk\/fiduceo\/looking-for-closure\/#breadcrumb"},"inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/research.reading.ac.uk\/fiduceo\/looking-for-closure\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/research.reading.ac.uk\/fiduceo\/looking-for-closure\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/research.reading.ac.uk\/fiduceo\/"},{"@type":"ListItem","position":2,"name":"Looking for closure"}]},{"@type":"WebSite","@id":"https:\/\/research.reading.ac.uk\/fiduceo\/#website","url":"https:\/\/research.reading.ac.uk\/fiduceo\/","name":"Fiduceo","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/research.reading.ac.uk\/fiduceo\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-GB"},{"@type":"Person","@id":"https:\/\/research.reading.ac.uk\/fiduceo\/#\/schema\/person\/532e1ce773445fb76d77785ea76f5be8","name":"Alex Daykin","image":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/research.reading.ac.uk\/fiduceo\/#\/schema\/person\/image\/26159086a629d325cff50dd27004d579","url":"https:\/\/secure.gravatar.com\/avatar\/48d6c4db18e4195997d9ec88cad612357d655264b37576280d9aceae3fa7aac4?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/48d6c4db18e4195997d9ec88cad612357d655264b37576280d9aceae3fa7aac4?s=96&d=mm&r=g","caption":"Alex Daykin"},"url":"https:\/\/research.reading.ac.uk\/fiduceo\/author\/a-j-daykinreading-ac-uk\/"}]}},"cc_featured_image_caption":{"caption_text":false,"source_text":false,"source_url":false},"_links":{"self":[{"href":"https:\/\/research.reading.ac.uk\/fiduceo\/wp-json\/wp\/v2\/posts\/1172","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/research.reading.ac.uk\/fiduceo\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/research.reading.ac.uk\/fiduceo\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/research.reading.ac.uk\/fiduceo\/wp-json\/wp\/v2\/users\/219"}],"replies":[{"embeddable":true,"href":"https:\/\/research.reading.ac.uk\/fiduceo\/wp-json\/wp\/v2\/comments?post=1172"}],"version-history":[{"count":5,"href":"https:\/\/research.reading.ac.uk\/fiduceo\/wp-json\/wp\/v2\/posts\/1172\/revisions"}],"predecessor-version":[{"id":1189,"href":"https:\/\/research.reading.ac.uk\/fiduceo\/wp-json\/wp\/v2\/posts\/1172\/revisions\/1189"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/research.reading.ac.uk\/fiduceo\/wp-json\/wp\/v2\/media\/588"}],"wp:attachment":[{"href":"https:\/\/research.reading.ac.uk\/fiduceo\/wp-json\/wp\/v2\/media?parent=1172"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/research.reading.ac.uk\/fiduceo\/wp-json\/wp\/v2\/categories?post=1172"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/research.reading.ac.uk\/fiduceo\/wp-json\/wp\/v2\/tags?post=1172"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/research.reading.ac.uk\/fiduceo\/wp-json\/wp\/v2\/coauthors?post=1172"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}