{"id":1268,"date":"2017-03-16T11:58:21","date_gmt":"2017-03-16T11:58:21","guid":{"rendered":"https:\/\/research.reading.ac.uk\/fiduceo\/?p=1268"},"modified":"2019-07-29T12:00:36","modified_gmt":"2019-07-29T11:00:36","slug":"including-estimates-of-uncertainty-in-climate-data-records","status":"publish","type":"post","link":"https:\/\/research.reading.ac.uk\/fiduceo\/including-estimates-of-uncertainty-in-climate-data-records\/","title":{"rendered":"Including estimates of uncertainty in climate data records"},"content":{"rendered":"by <a href=\"http:\/\/www.met.reading.ac.uk\/userpages\/nn904972.php\">Christopher Merchant<\/a>\r\n\r\n<!-- \/wp:post-content --><!-- wp:paragraph -->\r\n\r\nA <a href=\"http:\/\/www.earth-syst-sci-data-discuss.net\/essd-2017-16\/\">new paper<\/a>\u00a0in Earth System Science Data discusses uncertainty in climate data records (CDRs) from Earth Observation. It emerges from the European Space Agency <a href=\"http:\/\/cci.esa.int\">Climate Change Initiative<\/a>\u00a0project, and reviews across 11\u00a0different essential climate variables the status of including uncertainty information in CDRs. The paper reviews why uncertainty information matters, what it means (including how it is conceptually different to quality), and briefly reviews how uncertainty can be characterised and quantified. The ECVs\u00a0included are: aerosol optical depth, cloud properties, glacier extent, greenhouse gases,\u00a0land cover, ocean colour,\u00a0ozone, soil moisture, sea ice, sea level and sea surface temperature. The varied nature of these variables leads to a wide range of approaches to uncertainty characterisation, which are\u00a0summarised.. Nonetheless, the paper pulls together a number of recommendations for good practice that the FIDUCEO\u00a0project would certainly agree with:\r\n\r\n<!-- \/wp:paragraph --><!-- wp:paragraph -->\r\n\r\n1. Make quantitative uncertainty information available within the dataset. (Don\u2019t expect users to find uncertainty information from reading related papers.)\r\n\r\n<!-- \/wp:paragraph --><!-- wp:paragraph -->\r\n\r\n2. Use well-defined metrological concepts, such as &#8220;standard uncertainty&#8221;, to quantify uncertainty.\r\n\r\n<!-- \/wp:paragraph --><!-- wp:paragraph -->\r\n\r\n3. Provide uncertainty information that discriminates which data are more and less certain. Per-datum uncertainties should be given, if possible, in CDRs where uncertainty varies significantly.\r\n\r\n<!-- \/wp:paragraph --><!-- wp:paragraph -->\r\n\r\n4. Assuming per-datum uncertainty information is provided, avoid redundancy of this information with quality flags:\r\n\r\n<!-- \/wp:paragraph --><!-- wp:list -->\r\n<ul>\r\n \t<li>do not flag high-uncertainty data as \u201cbad\u201d if a valid estimate of that high uncertainty is provided;<\/li>\r\n \t<li>instead, use\u00a0quality flags to indicate the level of confidence in the validity of the provided uncertainty and retrieval assumptions.<\/li>\r\n<\/ul>\r\n<!-- \/wp:list --><!-- wp:paragraph -->\r\n\r\n5. Define what uncertainty information is given in the CDR in the product documentation.\r\n\r\n<!-- \/wp:paragraph --><!-- wp:paragraph -->\r\n\r\n6. Describe in the product documentation the main effects causing errors, how uncertainty varies within the dataset, how errors may be correlated in time and space, and under what circumstances estimated uncertainty may be invalid (and flagged as such).\r\n\r\n<!-- \/wp:paragraph --><!-- wp:paragraph -->\r\n\r\n7. Use validation to evaluate both retrieved quantities and uncertainty estimates.\r\n\r\n<!-- \/wp:paragraph --><!-- wp:paragraph -->\r\n\r\n8. Propagate uncertainty appropriately (accounting for error correlation) and consistently when creating aggregated products.\r\n\r\n<!-- \/wp:paragraph --><!-- wp:paragraph -->\r\n\r\nThis represents an overview of the outcomes of many discussions across the different project teams in ESA CCI and is significant progress compared to the level of mutual understanding between teams on how to handle uncertainty at the start of ESA CCI.\r\n\r\n<!-- \/wp:paragraph --><!-- wp:paragraph -->\r\n\r\nHowever, one aspect central to FIDUCEO is missing from the paper entirely: in CCI, the project teams by necessity have to add uncertainty information at level 2 (geophysical retrievals) without access to per-datum quantified uncertainties at level 1 (the radiances etc from which the climate data are inferred).This is a fundamental limitation of the current state of the art, and a key component of FIDUCEO is to show how characterisation of <a href=\"http:\/\/www.fiduceo.eu\/content\/why-worry-about-all-sources-errors\">the\u00a0uncertainty and error correlation structure at radiance level can usefully inform the creation of uncertainty estimates in derived climate data records<\/a>. The paper is in discussion at ESSD and comments can be made online as part of open peer review.","protected":false},"excerpt":{"rendered":"<p>A new paper shows progress in representing uncertainty in climate data, but the FIDUCEO approach will still bring a step change in rigour.<\/p>\n","protected":false},"author":219,"featured_media":466,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"__cvm_playback_settings":[],"__cvm_video_id":"","footnotes":""},"categories":[15],"tags":[],"coauthors":[6],"class_list":["post-1268","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-blog"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v21.8.1 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Including estimates of uncertainty in climate data records - Fiduceo<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/research.reading.ac.uk\/fiduceo\/including-estimates-of-uncertainty-in-climate-data-records\/\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Including estimates of uncertainty in climate data records - Fiduceo\" \/>\n<meta property=\"og:description\" content=\"A new paper shows progress in representing uncertainty in climate data, but the FIDUCEO approach will still bring a step change in rigour.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/research.reading.ac.uk\/fiduceo\/including-estimates-of-uncertainty-in-climate-data-records\/\" \/>\n<meta property=\"og:site_name\" content=\"Fiduceo\" \/>\n<meta property=\"article:published_time\" content=\"2017-03-16T11:58:21+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2019-07-29T11:00:36+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/research.reading.ac.uk\/fiduceo\/wp-content\/uploads\/sites\/129\/2019\/07\/essd-blog.png\" \/>\n\t<meta property=\"og:image:width\" content=\"906\" \/>\n\t<meta property=\"og:image:height\" content=\"712\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Alex Daykin\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Alex Daykin\" \/>\n\t<meta name=\"twitter:label2\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/research.reading.ac.uk\/fiduceo\/including-estimates-of-uncertainty-in-climate-data-records\/\",\"url\":\"https:\/\/research.reading.ac.uk\/fiduceo\/including-estimates-of-uncertainty-in-climate-data-records\/\",\"name\":\"Including estimates of uncertainty in climate data records - Fiduceo\",\"isPartOf\":{\"@id\":\"https:\/\/research.reading.ac.uk\/fiduceo\/#website\"},\"datePublished\":\"2017-03-16T11:58:21+00:00\",\"dateModified\":\"2019-07-29T11:00:36+00:00\",\"author\":{\"@id\":\"https:\/\/research.reading.ac.uk\/fiduceo\/#\/schema\/person\/532e1ce773445fb76d77785ea76f5be8\"},\"breadcrumb\":{\"@id\":\"https:\/\/research.reading.ac.uk\/fiduceo\/including-estimates-of-uncertainty-in-climate-data-records\/#breadcrumb\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/research.reading.ac.uk\/fiduceo\/including-estimates-of-uncertainty-in-climate-data-records\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/research.reading.ac.uk\/fiduceo\/including-estimates-of-uncertainty-in-climate-data-records\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/research.reading.ac.uk\/fiduceo\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Including estimates of uncertainty in climate data records\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/research.reading.ac.uk\/fiduceo\/#website\",\"url\":\"https:\/\/research.reading.ac.uk\/fiduceo\/\",\"name\":\"Fiduceo\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/research.reading.ac.uk\/fiduceo\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-GB\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/research.reading.ac.uk\/fiduceo\/#\/schema\/person\/532e1ce773445fb76d77785ea76f5be8\",\"name\":\"Alex Daykin\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\/\/research.reading.ac.uk\/fiduceo\/#\/schema\/person\/image\/26159086a629d325cff50dd27004d579\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/48d6c4db18e4195997d9ec88cad612357d655264b37576280d9aceae3fa7aac4?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/48d6c4db18e4195997d9ec88cad612357d655264b37576280d9aceae3fa7aac4?s=96&d=mm&r=g\",\"caption\":\"Alex Daykin\"},\"url\":\"https:\/\/research.reading.ac.uk\/fiduceo\/author\/a-j-daykinreading-ac-uk\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Including estimates of uncertainty in climate data records - Fiduceo","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/research.reading.ac.uk\/fiduceo\/including-estimates-of-uncertainty-in-climate-data-records\/","og_locale":"en_GB","og_type":"article","og_title":"Including estimates of uncertainty in climate data records - Fiduceo","og_description":"A new paper shows progress in representing uncertainty in climate data, but the FIDUCEO approach will still bring a step change in rigour.","og_url":"https:\/\/research.reading.ac.uk\/fiduceo\/including-estimates-of-uncertainty-in-climate-data-records\/","og_site_name":"Fiduceo","article_published_time":"2017-03-16T11:58:21+00:00","article_modified_time":"2019-07-29T11:00:36+00:00","og_image":[{"width":906,"height":712,"url":"https:\/\/research.reading.ac.uk\/fiduceo\/wp-content\/uploads\/sites\/129\/2019\/07\/essd-blog.png","type":"image\/png"}],"author":"Alex Daykin","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Alex Daykin","Estimated reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/research.reading.ac.uk\/fiduceo\/including-estimates-of-uncertainty-in-climate-data-records\/","url":"https:\/\/research.reading.ac.uk\/fiduceo\/including-estimates-of-uncertainty-in-climate-data-records\/","name":"Including estimates of uncertainty in climate data records - Fiduceo","isPartOf":{"@id":"https:\/\/research.reading.ac.uk\/fiduceo\/#website"},"datePublished":"2017-03-16T11:58:21+00:00","dateModified":"2019-07-29T11:00:36+00:00","author":{"@id":"https:\/\/research.reading.ac.uk\/fiduceo\/#\/schema\/person\/532e1ce773445fb76d77785ea76f5be8"},"breadcrumb":{"@id":"https:\/\/research.reading.ac.uk\/fiduceo\/including-estimates-of-uncertainty-in-climate-data-records\/#breadcrumb"},"inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/research.reading.ac.uk\/fiduceo\/including-estimates-of-uncertainty-in-climate-data-records\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/research.reading.ac.uk\/fiduceo\/including-estimates-of-uncertainty-in-climate-data-records\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/research.reading.ac.uk\/fiduceo\/"},{"@type":"ListItem","position":2,"name":"Including estimates of uncertainty in climate data records"}]},{"@type":"WebSite","@id":"https:\/\/research.reading.ac.uk\/fiduceo\/#website","url":"https:\/\/research.reading.ac.uk\/fiduceo\/","name":"Fiduceo","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/research.reading.ac.uk\/fiduceo\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-GB"},{"@type":"Person","@id":"https:\/\/research.reading.ac.uk\/fiduceo\/#\/schema\/person\/532e1ce773445fb76d77785ea76f5be8","name":"Alex Daykin","image":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/research.reading.ac.uk\/fiduceo\/#\/schema\/person\/image\/26159086a629d325cff50dd27004d579","url":"https:\/\/secure.gravatar.com\/avatar\/48d6c4db18e4195997d9ec88cad612357d655264b37576280d9aceae3fa7aac4?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/48d6c4db18e4195997d9ec88cad612357d655264b37576280d9aceae3fa7aac4?s=96&d=mm&r=g","caption":"Alex Daykin"},"url":"https:\/\/research.reading.ac.uk\/fiduceo\/author\/a-j-daykinreading-ac-uk\/"}]}},"cc_featured_image_caption":{"caption_text":false,"source_text":false,"source_url":false},"_links":{"self":[{"href":"https:\/\/research.reading.ac.uk\/fiduceo\/wp-json\/wp\/v2\/posts\/1268","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/research.reading.ac.uk\/fiduceo\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/research.reading.ac.uk\/fiduceo\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/research.reading.ac.uk\/fiduceo\/wp-json\/wp\/v2\/users\/219"}],"replies":[{"embeddable":true,"href":"https:\/\/research.reading.ac.uk\/fiduceo\/wp-json\/wp\/v2\/comments?post=1268"}],"version-history":[{"count":2,"href":"https:\/\/research.reading.ac.uk\/fiduceo\/wp-json\/wp\/v2\/posts\/1268\/revisions"}],"predecessor-version":[{"id":1271,"href":"https:\/\/research.reading.ac.uk\/fiduceo\/wp-json\/wp\/v2\/posts\/1268\/revisions\/1271"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/research.reading.ac.uk\/fiduceo\/wp-json\/wp\/v2\/media\/466"}],"wp:attachment":[{"href":"https:\/\/research.reading.ac.uk\/fiduceo\/wp-json\/wp\/v2\/media?parent=1268"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/research.reading.ac.uk\/fiduceo\/wp-json\/wp\/v2\/categories?post=1268"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/research.reading.ac.uk\/fiduceo\/wp-json\/wp\/v2\/tags?post=1268"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/research.reading.ac.uk\/fiduceo\/wp-json\/wp\/v2\/coauthors?post=1268"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}