{"id":1323,"date":"2015-07-15T13:40:58","date_gmt":"2015-07-15T12:40:58","guid":{"rendered":"https:\/\/research.reading.ac.uk\/fiduceo\/?p=1323"},"modified":"2019-07-29T13:42:50","modified_gmt":"2019-07-29T12:42:50","slug":"why-worry-about-all-sources-of-errors","status":"publish","type":"post","link":"https:\/\/research.reading.ac.uk\/fiduceo\/why-worry-about-all-sources-of-errors\/","title":{"rendered":"Why worry about all sources of errors?"},"content":{"rendered":"by <a href=\"http:\/\/www.met.reading.ac.uk\/users\/users\/1942\">Chris Merchant<\/a>\r\n\r\n<!-- \/wp:post-content --><!-- wp:paragraph -->\r\n\r\nThere are many effects that act as sources of errors in a climate data record. No measured value is perfect, whether taken in the laboratory or inferred from radiances measured in low Earth orbit.\r\n\r\n<!-- \/wp:paragraph --><!-- wp:paragraph -->\r\n\r\nThe most obvious characteristic to establish about a source of error is the magnitude of its effect. The (standard) uncertainty is a measure of the typical size of errors, and is generally what is represented by &#8220;error bars&#8221; on a plot.\r\n\r\n<!-- \/wp:paragraph --><!-- wp:paragraph -->\r\n\r\nLess obvious is the need to know whether the error is correlated between different measured values. This becomes very important for climate data records: looking at climate change, highly correlated errors are the ones we need to worry about.\r\n\r\n<!-- \/wp:paragraph --><!-- wp:paragraph -->\r\n\r\nTo illustrate this, consider a climate data record (CDR) for sea surface temperature (SST). Full resolution satellite data typically measures an instantaneous SST across a pixel of about 1 km. For a typical case, we might have three categories of effect, causing uncertainties of different size:\r\n\r\n<!-- \/wp:paragraph --><!-- wp:list -->\r\n<ul>\r\n \t<li>Noise, which is uncorrelated between different pixels.<\/li>\r\n \t<li>Ambiguity in obtaining the SST from the measured radiances, which tends to be correlated &#8220;locally&#8221;, where the state of the atmosphere is similar.<\/li>\r\n \t<li>Systematic errors (&#8220;biases&#8221;) including sensor calibration degradation over time, which tend to affect measured values in a highly correlated (non-random) way.<\/li>\r\n<\/ul>\r\n<!-- \/wp:list --><!-- wp:paragraph -->\r\n\r\nData producers tend to put effort into correcting any &#8220;biases&#8221;, but nonetheless, residual uncertainty remains after such corrections are applied.\r\n\r\n<!-- \/wp:paragraph --><!-- wp:paragraph -->\r\n\r\nFor a single instantaneously measured SST from a well-designed instrument, the first two effects are the biggest, and may be comparable.\r\n\r\n<!-- \/wp:paragraph --><!-- wp:paragraph -->\r\n\r\nHowever, for climate change analyses, we may be more interested in how SST over one area and period of time compares with SST for that area at a different time. The larger the spatial scale and longer the period of time considered, the less important noise becomes (the SST errors tend to average down when data are aggregated) and the relatively more important calibration effects become.\r\n\r\n<!-- \/wp:paragraph --><!-- wp:image {\"linkDestination\":\"custom\"} -->\r\n<figure class=\"wp-block-image\"><a href=\"http:\/\/4.bp.blogspot.com\/-7qXOh2Qve7g\/VaU-uXEpkEI\/AAAAAAAAAEE\/GbezLCO34HE\/s1600\/SST-example.png\"><img decoding=\"async\" src=\"http:\/\/4.bp.blogspot.com\/-7qXOh2Qve7g\/VaU-uXEpkEI\/AAAAAAAAAEE\/GbezLCO34HE\/s320\/SST-example.png\" alt=\"\" \/><\/a><\/figure>\r\n<!-- \/wp:image --><!-- wp:paragraph -->\r\n\r\nThis figure illustrates this effect for a reasonable set of assumptions for the case of SST. In a single 1 km SST retrieval, the random effects may dominate the uncertainty, followed by the locally systematic effects associated with retrieval ambiguity. However, as the scale of analysis of the SST data becomes larger in space and longer in time, first noise and then locally systematic effects become less important.\r\n\r\n<!-- \/wp:paragraph --><!-- wp:paragraph -->\r\n\r\nIf we are using the CDR across several years, more than one sensor is involved. In that\u00a0case, not only systematic calibration effects from a single sensor matter, but uncertainty in the (corrected) systematic differences between instruments in the sensor series also begin to matter.\r\n\r\n<!-- \/wp:paragraph --><!-- wp:paragraph -->\r\n\r\nAnalyses of uncertainty budgets in SST products and for instrument design often focus on the regime at the left side of this diagram, where calibration effects (after bias correction) may be thought negligible. But CDRs also get used for applications at the right side of this diagram, where the systematic effects matter most.\r\n\r\n<!-- \/wp:paragraph --><!-- wp:paragraph -->\r\n\r\nWhen it comes to creating climate data records, all categories of effect causing uncertainty need to be considered and characterised, as far as practicable. All types of error source are relevant to the applications of at least some CDR users.","protected":false},"excerpt":{"rendered":"<p>Using sea surface temperature as an example, this blog explores the importance of assessing all sources of error in climate data.<\/p>\n","protected":false},"author":219,"featured_media":374,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"__cvm_playback_settings":[],"__cvm_video_id":"","footnotes":""},"categories":[15],"tags":[],"coauthors":[6],"class_list":["post-1323","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-blog"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v21.8.1 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Why worry about all sources of errors? - Fiduceo<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/research.reading.ac.uk\/fiduceo\/why-worry-about-all-sources-of-errors\/\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Why worry about all sources of errors? - Fiduceo\" \/>\n<meta property=\"og:description\" content=\"Using sea surface temperature as an example, this blog explores the importance of assessing all sources of error in climate data.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/research.reading.ac.uk\/fiduceo\/why-worry-about-all-sources-of-errors\/\" \/>\n<meta property=\"og:site_name\" content=\"Fiduceo\" \/>\n<meta property=\"article:published_time\" content=\"2015-07-15T12:40:58+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2019-07-29T12:42:50+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/research.reading.ac.uk\/fiduceo\/wp-content\/uploads\/sites\/129\/2019\/07\/hawaii-63111_1280.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1280\" \/>\n\t<meta property=\"og:image:height\" content=\"995\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Alex Daykin\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Alex Daykin\" \/>\n\t<meta name=\"twitter:label2\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/research.reading.ac.uk\/fiduceo\/why-worry-about-all-sources-of-errors\/\",\"url\":\"https:\/\/research.reading.ac.uk\/fiduceo\/why-worry-about-all-sources-of-errors\/\",\"name\":\"Why worry about all sources of errors? - Fiduceo\",\"isPartOf\":{\"@id\":\"https:\/\/research.reading.ac.uk\/fiduceo\/#website\"},\"datePublished\":\"2015-07-15T12:40:58+00:00\",\"dateModified\":\"2019-07-29T12:42:50+00:00\",\"author\":{\"@id\":\"https:\/\/research.reading.ac.uk\/fiduceo\/#\/schema\/person\/532e1ce773445fb76d77785ea76f5be8\"},\"breadcrumb\":{\"@id\":\"https:\/\/research.reading.ac.uk\/fiduceo\/why-worry-about-all-sources-of-errors\/#breadcrumb\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/research.reading.ac.uk\/fiduceo\/why-worry-about-all-sources-of-errors\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/research.reading.ac.uk\/fiduceo\/why-worry-about-all-sources-of-errors\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/research.reading.ac.uk\/fiduceo\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Why worry about all sources of errors?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/research.reading.ac.uk\/fiduceo\/#website\",\"url\":\"https:\/\/research.reading.ac.uk\/fiduceo\/\",\"name\":\"Fiduceo\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/research.reading.ac.uk\/fiduceo\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-GB\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/research.reading.ac.uk\/fiduceo\/#\/schema\/person\/532e1ce773445fb76d77785ea76f5be8\",\"name\":\"Alex Daykin\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\/\/research.reading.ac.uk\/fiduceo\/#\/schema\/person\/image\/26159086a629d325cff50dd27004d579\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/48d6c4db18e4195997d9ec88cad612357d655264b37576280d9aceae3fa7aac4?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/48d6c4db18e4195997d9ec88cad612357d655264b37576280d9aceae3fa7aac4?s=96&d=mm&r=g\",\"caption\":\"Alex Daykin\"},\"url\":\"https:\/\/research.reading.ac.uk\/fiduceo\/author\/a-j-daykinreading-ac-uk\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Why worry about all sources of errors? - Fiduceo","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/research.reading.ac.uk\/fiduceo\/why-worry-about-all-sources-of-errors\/","og_locale":"en_GB","og_type":"article","og_title":"Why worry about all sources of errors? - Fiduceo","og_description":"Using sea surface temperature as an example, this blog explores the importance of assessing all sources of error in climate data.","og_url":"https:\/\/research.reading.ac.uk\/fiduceo\/why-worry-about-all-sources-of-errors\/","og_site_name":"Fiduceo","article_published_time":"2015-07-15T12:40:58+00:00","article_modified_time":"2019-07-29T12:42:50+00:00","og_image":[{"width":1280,"height":995,"url":"https:\/\/research.reading.ac.uk\/fiduceo\/wp-content\/uploads\/sites\/129\/2019\/07\/hawaii-63111_1280.jpg","type":"image\/jpeg"}],"author":"Alex Daykin","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Alex Daykin","Estimated reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/research.reading.ac.uk\/fiduceo\/why-worry-about-all-sources-of-errors\/","url":"https:\/\/research.reading.ac.uk\/fiduceo\/why-worry-about-all-sources-of-errors\/","name":"Why worry about all sources of errors? - Fiduceo","isPartOf":{"@id":"https:\/\/research.reading.ac.uk\/fiduceo\/#website"},"datePublished":"2015-07-15T12:40:58+00:00","dateModified":"2019-07-29T12:42:50+00:00","author":{"@id":"https:\/\/research.reading.ac.uk\/fiduceo\/#\/schema\/person\/532e1ce773445fb76d77785ea76f5be8"},"breadcrumb":{"@id":"https:\/\/research.reading.ac.uk\/fiduceo\/why-worry-about-all-sources-of-errors\/#breadcrumb"},"inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/research.reading.ac.uk\/fiduceo\/why-worry-about-all-sources-of-errors\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/research.reading.ac.uk\/fiduceo\/why-worry-about-all-sources-of-errors\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/research.reading.ac.uk\/fiduceo\/"},{"@type":"ListItem","position":2,"name":"Why worry about all sources of errors?"}]},{"@type":"WebSite","@id":"https:\/\/research.reading.ac.uk\/fiduceo\/#website","url":"https:\/\/research.reading.ac.uk\/fiduceo\/","name":"Fiduceo","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/research.reading.ac.uk\/fiduceo\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-GB"},{"@type":"Person","@id":"https:\/\/research.reading.ac.uk\/fiduceo\/#\/schema\/person\/532e1ce773445fb76d77785ea76f5be8","name":"Alex Daykin","image":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/research.reading.ac.uk\/fiduceo\/#\/schema\/person\/image\/26159086a629d325cff50dd27004d579","url":"https:\/\/secure.gravatar.com\/avatar\/48d6c4db18e4195997d9ec88cad612357d655264b37576280d9aceae3fa7aac4?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/48d6c4db18e4195997d9ec88cad612357d655264b37576280d9aceae3fa7aac4?s=96&d=mm&r=g","caption":"Alex Daykin"},"url":"https:\/\/research.reading.ac.uk\/fiduceo\/author\/a-j-daykinreading-ac-uk\/"}]}},"cc_featured_image_caption":{"caption_text":false,"source_text":false,"source_url":false},"_links":{"self":[{"href":"https:\/\/research.reading.ac.uk\/fiduceo\/wp-json\/wp\/v2\/posts\/1323","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/research.reading.ac.uk\/fiduceo\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/research.reading.ac.uk\/fiduceo\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/research.reading.ac.uk\/fiduceo\/wp-json\/wp\/v2\/users\/219"}],"replies":[{"embeddable":true,"href":"https:\/\/research.reading.ac.uk\/fiduceo\/wp-json\/wp\/v2\/comments?post=1323"}],"version-history":[{"count":2,"href":"https:\/\/research.reading.ac.uk\/fiduceo\/wp-json\/wp\/v2\/posts\/1323\/revisions"}],"predecessor-version":[{"id":1326,"href":"https:\/\/research.reading.ac.uk\/fiduceo\/wp-json\/wp\/v2\/posts\/1323\/revisions\/1326"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/research.reading.ac.uk\/fiduceo\/wp-json\/wp\/v2\/media\/374"}],"wp:attachment":[{"href":"https:\/\/research.reading.ac.uk\/fiduceo\/wp-json\/wp\/v2\/media?parent=1323"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/research.reading.ac.uk\/fiduceo\/wp-json\/wp\/v2\/categories?post=1323"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/research.reading.ac.uk\/fiduceo\/wp-json\/wp\/v2\/tags?post=1323"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/research.reading.ac.uk\/fiduceo\/wp-json\/wp\/v2\/coauthors?post=1323"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}