{"id":578,"date":"2018-06-25T09:44:05","date_gmt":"2018-06-25T08:44:05","guid":{"rendered":"https:\/\/research.reading.ac.uk\/dare\/?p=578"},"modified":"2018-11-12T10:11:28","modified_gmt":"2018-11-12T10:11:28","slug":"coping-with-large-numbers-of-observations","status":"publish","type":"post","link":"https:\/\/research.reading.ac.uk\/dare\/2018\/06\/25\/coping-with-large-numbers-of-observations\/","title":{"rendered":"Coping with large numbers of observations"},"content":{"rendered":"<p><em>Takuya Kurihana has received funding from the DARE training fund to attend Data Assimilation tutorials at the Workshop on Sensitivity Analysis and Data Assimilation in Meteorology and Oceanography, 1-6 July 2018,\u00a0Aveiro, Portugal. Here he writes about himself and his research.\u00a0<\/em><\/p>\n<p>&nbsp;<\/p>\n<p>What if we could more accurately predict what atmospheric phenomenon will happen in the next minute, hour and day using the current limited information. This scientific question has inspired me to be being involved in the research activity since undergraduate student. I am Takuya Kurihana, a Meteorology MS student in the University of Tsukuba under the supervision of Dr. Hiroshi L. Tanaka, and an incoming Computer Science PhD student in the University of Chicago. My current research focuses on 1. How to improve the accuracy of weather forecasting: \u201cPredictability\u201d, and 2. How to make use of a massive amount of dense meteorological dataset for data assimilation. With developing new application for purpose 2, I am now researching the impact of using a large amount of atmospheric observation as much as we can towards the daily scale weather forecast.<\/p>\n<p>&nbsp;<\/p>\n<p>Regarding to the improvement predictability, as a previous article explained by Zak Bell,\u00a0<a href=\"https:\/\/research.reading.ac.uk\/dare\/2018\/03\/12\/making-the-most-of-uncertain-urban-observations\/\">Making the Most of Uncertain Urban Observations<\/a> , data assimilation plays an imperative role in numerical weather prediction because the longer we run a numerical weather forecasting model, the larger the error of forecast grows up. This is because the uncertainty. Even if we use the most precise model, this tendency would not change more or less. But, applying the data assimilation methods can minimize the error by installing observation into the optimization process Fig.1 is an example experiment about an advantage of data assimilation. Therefore, we have to gather a variety of denser observation data from both horizontally and vertically wider range of points in real operation. Other than land observation (Figure 2) [1], sondes, and buoys, recent satellite observation (Figure 3 and Figure 4) [2, 3], which provide us much richer and denser information, have been utilized in operational data assimilation processes.<\/p>\n<p>&nbsp;<\/p>\n<p>The spatially condensed satellite data, however, causes one problem in the current data assimilation methods. The issue is that too much dense data will rather deteriorate the quality of assimilation products based on previous researches. Simply put, we have to leave out large proportion of these data: \u201cThinning\u201d, even while the technology of meteorological satellites is advancing. Moreover, there are several resource limitations to prepare the forecasting since we are not afford to compute endlessly, and the performance and size of computer are constrained. In order to make use of larger proportion of these data while not reducing assimilation quality, the spatial interpolation, so called super-observation (SO) procedure are developed. As one SO system, I proposed a new algorithm which could deal with a massive amount of satellite big data efficiently and speedily within a cloud-resolving model (Nonhydrostatic ICosahedral Atmospheric Model; NICAM) grid coordination. The algorithm primary targets to reduce \u201cDo\/For Loop\u201d iteration process to find the nearest model grid location, which can also skip the computation by a complex observation operator.<\/p>\n<p>&nbsp;<\/p>\n<p>Which is better Thinning or SO? Although this would be controversial discussion among meteorologists, I would like to give one example in the Workshop on Sensitivity Analysis and Data Assimilation in Portugal. While the new application should be tested in further numerical experiments through my master research project, I ponder that we should consider a more efficient usage of these meteorological \u201cBig Data\u201d in the near future. Through the attendance at the workshop, I would like to discuss my application and its effect on the data assimilation, as well as receive fruitful advice from cutting edge researchers.<\/p>\n<p><iframe loading=\"lazy\" title=\"Lorenz 63 - EnKF by Python (High Quality version)\" width=\"640\" height=\"480\" src=\"https:\/\/www.youtube.com\/embed\/VA29KRjlNTk?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><\/p>\n<p>&nbsp;<\/p>\n<p>Figure 1. These timeseries of trajectories imply a small difference between two initial conditions finally ends up completely varied behaviors. Blue is No data assimilation from 200 time steps, and Red is data assimilation Lorenz63 Trajectory. Demo above by Takuya Kurihana.<\/p>\n<p class=\"hide-if-no-js\"><a id=\"set-post-thumbnail\" class=\"thickbox\" href=\"https:\/\/research.reading.ac.uk\/dare\/wp-admin\/media-upload.php?post_id=578&amp;type=image&amp;TB_iframe=1\"><img loading=\"lazy\" decoding=\"async\" class=\"attachment-266x266 \" src=\"https:\/\/research.reading.ac.uk\/dare\/wp-content\/uploads\/sites\/5\/Lorenz-63-2.png\" alt=\"\" width=\"842\" height=\"421\" \/><\/a><\/p>\n<p>Figure. 2 \u00a0This map shows the sparse location of land observation points<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-583\" src=\"https:\/\/research.reading.ac.uk\/dare\/wp-content\/uploads\/sites\/5\/Image-from-DWD.jpg\" alt=\"\" width=\"660\" height=\"424\" srcset=\"https:\/\/research.reading.ac.uk\/dare\/wp-content\/uploads\/sites\/5\/Image-from-DWD.jpg 950w, https:\/\/research.reading.ac.uk\/dare\/wp-content\/uploads\/sites\/5\/Image-from-DWD-300x193.jpg 300w, https:\/\/research.reading.ac.uk\/dare\/wp-content\/uploads\/sites\/5\/Image-from-DWD-768x493.jpg 768w\" sizes=\"auto, (max-width: 660px) 100vw, 660px\" \/><\/p>\n<p>&nbsp;<\/p>\n<figure id=\"attachment_675\" aria-describedby=\"caption-attachment-675\" style=\"width: 800px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-675 size-large\" src=\"https:\/\/research.reading.ac.uk\/dare\/wp-content\/uploads\/sites\/5\/Unorganized\/PolarOrbitingSatelliteTracks-1024x580.png\" alt=\"\" width=\"800\" height=\"453\" srcset=\"https:\/\/research.reading.ac.uk\/dare\/wp-content\/uploads\/sites\/5\/Unorganized\/PolarOrbitingSatelliteTracks-1024x580.png 1024w, https:\/\/research.reading.ac.uk\/dare\/wp-content\/uploads\/sites\/5\/Unorganized\/PolarOrbitingSatelliteTracks-300x170.png 300w, https:\/\/research.reading.ac.uk\/dare\/wp-content\/uploads\/sites\/5\/Unorganized\/PolarOrbitingSatelliteTracks-768x435.png 768w\" sizes=\"auto, (max-width: 800px) 100vw, 800px\" \/><figcaption id=\"caption-attachment-675\" class=\"wp-caption-text\">Figure 3. Map of the polar-orbiting constellation coverage from one GDAS cycle for 3 polar configurations (taken from Boukabara et al. 2016)<\/figcaption><\/figure>\n<p>&nbsp;<\/p>\n<figure id=\"attachment_677\" aria-describedby=\"caption-attachment-677\" style=\"width: 835px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-677\" src=\"https:\/\/research.reading.ac.uk\/dare\/wp-content\/uploads\/sites\/5\/Unorganized\/GeostationarySatteliteData.png\" alt=\"\" width=\"835\" height=\"625\" srcset=\"https:\/\/research.reading.ac.uk\/dare\/wp-content\/uploads\/sites\/5\/Unorganized\/GeostationarySatteliteData.png 835w, https:\/\/research.reading.ac.uk\/dare\/wp-content\/uploads\/sites\/5\/Unorganized\/GeostationarySatteliteData-300x225.png 300w, https:\/\/research.reading.ac.uk\/dare\/wp-content\/uploads\/sites\/5\/Unorganized\/GeostationarySatteliteData-768x575.png 768w\" sizes=\"auto, (max-width: 835px) 100vw, 835px\" \/><figcaption id=\"caption-attachment-677\" class=\"wp-caption-text\">Figure 4. Location of all AMVs used in the data assimilation for the UK Met Office model in 2013 (Source: UK Met Office, http:\/\/www.eumetrain.org\/data\/4\/438\/navmenu.php?tab=2&amp;page=2.0.0).<\/figcaption><\/figure>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>[1] <a href=\"https:\/\/www.dwd.de\/EN\/research\/weatherforecasting\/num_modelling\/02_data_assimilation\/data_assimilation_node.html\">https:\/\/www.dwd.de\/EN\/research\/weatherforecasting\/num_modelling\/02_data_assimilation\/data_assimilation_node.html<\/a><\/p>\n<p>[2] S-A. Boukabara, K. Garrett, K. V. Kumar, &#8220;Potential Gaps in the Satellite Observing System Coverage: Assessment of Impact on NOAA&#8217;\u0080\u0099s Numerical Weather Prediction Overall Skills&#8221;. (2016). Mon. Wea. Rev., 144, 2547\u20132563, <a href=\"https:\/\/doi.org\/10.1175\/MWR-D-16-0013.1\">https:\/\/doi.org\/10.1175\/ MWR-D-16-0013.1.<\/a><\/p>\n<p>[3] <a href=\"http:\/\/www.eumetrain.org\/data\/4\/438\/navmenu.php?tab=2&amp;page=2.0.0\" class=\"broken_link\">http:\/\/www.eumetrain.org\/data\/4\/438\/navmenu.php?tab=2&amp;page=2.0.0 <\/a><\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Takuya Kurihana has received funding from the DARE training fund to attend Data Assimilation tutorials at the Workshop on Sensitivity Analysis and Data Assimilation in Meteorology and Oceanography, 1-6 July&#8230;<a class=\"read-more\" href=\"&#104;&#116;&#116;&#112;&#115;&#58;&#47;&#47;&#114;&#101;&#115;&#101;&#97;&#114;&#99;&#104;&#46;&#114;&#101;&#97;&#100;&#105;&#110;&#103;&#46;&#97;&#99;&#46;&#117;&#107;&#47;&#100;&#97;&#114;&#101;&#47;&#50;&#48;&#49;&#56;&#47;&#48;&#54;&#47;&#50;&#53;&#47;&#99;&#111;&#112;&#105;&#110;&#103;&#45;&#119;&#105;&#116;&#104;&#45;&#108;&#97;&#114;&#103;&#101;&#45;&#110;&#117;&#109;&#98;&#101;&#114;&#115;&#45;&#111;&#102;&#45;&#111;&#98;&#115;&#101;&#114;&#118;&#97;&#116;&#105;&#111;&#110;&#115;&#47;\">Read More ><\/a><\/p>\n","protected":false},"author":23,"featured_media":581,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"__cvm_playback_settings":[],"__cvm_video_id":"","footnotes":"","_links_to":"","_links_to_target":""},"categories":[3,4,39],"tags":[],"class_list":["post-578","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-conferences","category-data-assimilation","category-training"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v21.8.1 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Coping with large numbers of observations - DARE<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/research.reading.ac.uk\/dare\/2018\/06\/25\/coping-with-large-numbers-of-observations\/\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Coping with large numbers of observations - DARE\" \/>\n<meta property=\"og:description\" content=\"Takuya Kurihana has received funding from the DARE training fund to attend Data Assimilation tutorials at the Workshop on Sensitivity Analysis and Data Assimilation in Meteorology and Oceanography, 1-6 July...Read More &gt;\" \/>\n<meta property=\"og:url\" content=\"https:\/\/research.reading.ac.uk\/dare\/2018\/06\/25\/coping-with-large-numbers-of-observations\/\" \/>\n<meta property=\"og:site_name\" content=\"DARE\" \/>\n<meta property=\"article:published_time\" content=\"2018-06-25T08:44:05+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2018-11-12T10:11:28+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/research.reading.ac.uk\/dare\/wp-content\/uploads\/sites\/5\/Lorenz-63-2.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1152\" \/>\n\t<meta property=\"og:image:height\" content=\"576\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Jessica Gardner\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Jessica Gardner\" \/>\n\t<meta name=\"twitter:label2\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/research.reading.ac.uk\/dare\/2018\/06\/25\/coping-with-large-numbers-of-observations\/\",\"url\":\"https:\/\/research.reading.ac.uk\/dare\/2018\/06\/25\/coping-with-large-numbers-of-observations\/\",\"name\":\"Coping with large numbers of observations - DARE\",\"isPartOf\":{\"@id\":\"https:\/\/research.reading.ac.uk\/dare\/#website\"},\"datePublished\":\"2018-06-25T08:44:05+00:00\",\"dateModified\":\"2018-11-12T10:11:28+00:00\",\"author\":{\"@id\":\"https:\/\/research.reading.ac.uk\/dare\/#\/schema\/person\/e0cdff4a2766962bcad80bcfdd6b58d0\"},\"breadcrumb\":{\"@id\":\"https:\/\/research.reading.ac.uk\/dare\/2018\/06\/25\/coping-with-large-numbers-of-observations\/#breadcrumb\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/research.reading.ac.uk\/dare\/2018\/06\/25\/coping-with-large-numbers-of-observations\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/research.reading.ac.uk\/dare\/2018\/06\/25\/coping-with-large-numbers-of-observations\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/research.reading.ac.uk\/dare\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Coping with large numbers of observations\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/research.reading.ac.uk\/dare\/#website\",\"url\":\"https:\/\/research.reading.ac.uk\/dare\/\",\"name\":\"DARE\",\"description\":\"Data Assimilation for the REsilient City\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/research.reading.ac.uk\/dare\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-GB\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/research.reading.ac.uk\/dare\/#\/schema\/person\/e0cdff4a2766962bcad80bcfdd6b58d0\",\"name\":\"Jessica Gardner\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\/\/research.reading.ac.uk\/dare\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/8a6d2ee6cf3a71e60790de38cd5aed0ce278defcb8bf720d2c12bd009294ec78?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/8a6d2ee6cf3a71e60790de38cd5aed0ce278defcb8bf720d2c12bd009294ec78?s=96&d=mm&r=g\",\"caption\":\"Jessica Gardner\"},\"url\":\"https:\/\/research.reading.ac.uk\/dare\/author\/jessica-gardnerreading-ac-uk\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Coping with large numbers of observations - DARE","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/research.reading.ac.uk\/dare\/2018\/06\/25\/coping-with-large-numbers-of-observations\/","og_locale":"en_GB","og_type":"article","og_title":"Coping with large numbers of observations - DARE","og_description":"Takuya Kurihana has received funding from the DARE training fund to attend Data Assimilation tutorials at the Workshop on Sensitivity Analysis and Data Assimilation in Meteorology and Oceanography, 1-6 July...Read More >","og_url":"https:\/\/research.reading.ac.uk\/dare\/2018\/06\/25\/coping-with-large-numbers-of-observations\/","og_site_name":"DARE","article_published_time":"2018-06-25T08:44:05+00:00","article_modified_time":"2018-11-12T10:11:28+00:00","og_image":[{"width":1152,"height":576,"url":"https:\/\/research.reading.ac.uk\/dare\/wp-content\/uploads\/sites\/5\/Lorenz-63-2.png","type":"image\/png"}],"author":"Jessica Gardner","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Jessica Gardner","Estimated reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/research.reading.ac.uk\/dare\/2018\/06\/25\/coping-with-large-numbers-of-observations\/","url":"https:\/\/research.reading.ac.uk\/dare\/2018\/06\/25\/coping-with-large-numbers-of-observations\/","name":"Coping with large numbers of observations - DARE","isPartOf":{"@id":"https:\/\/research.reading.ac.uk\/dare\/#website"},"datePublished":"2018-06-25T08:44:05+00:00","dateModified":"2018-11-12T10:11:28+00:00","author":{"@id":"https:\/\/research.reading.ac.uk\/dare\/#\/schema\/person\/e0cdff4a2766962bcad80bcfdd6b58d0"},"breadcrumb":{"@id":"https:\/\/research.reading.ac.uk\/dare\/2018\/06\/25\/coping-with-large-numbers-of-observations\/#breadcrumb"},"inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/research.reading.ac.uk\/dare\/2018\/06\/25\/coping-with-large-numbers-of-observations\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/research.reading.ac.uk\/dare\/2018\/06\/25\/coping-with-large-numbers-of-observations\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/research.reading.ac.uk\/dare\/"},{"@type":"ListItem","position":2,"name":"Coping with large numbers of observations"}]},{"@type":"WebSite","@id":"https:\/\/research.reading.ac.uk\/dare\/#website","url":"https:\/\/research.reading.ac.uk\/dare\/","name":"DARE","description":"Data Assimilation for the REsilient City","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/research.reading.ac.uk\/dare\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-GB"},{"@type":"Person","@id":"https:\/\/research.reading.ac.uk\/dare\/#\/schema\/person\/e0cdff4a2766962bcad80bcfdd6b58d0","name":"Jessica Gardner","image":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/research.reading.ac.uk\/dare\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/8a6d2ee6cf3a71e60790de38cd5aed0ce278defcb8bf720d2c12bd009294ec78?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/8a6d2ee6cf3a71e60790de38cd5aed0ce278defcb8bf720d2c12bd009294ec78?s=96&d=mm&r=g","caption":"Jessica Gardner"},"url":"https:\/\/research.reading.ac.uk\/dare\/author\/jessica-gardnerreading-ac-uk\/"}]}},"cc_featured_image_caption":{"caption_text":false,"source_text":false,"source_url":false},"_links":{"self":[{"href":"https:\/\/research.reading.ac.uk\/dare\/wp-json\/wp\/v2\/posts\/578","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/research.reading.ac.uk\/dare\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/research.reading.ac.uk\/dare\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/research.reading.ac.uk\/dare\/wp-json\/wp\/v2\/users\/23"}],"replies":[{"embeddable":true,"href":"https:\/\/research.reading.ac.uk\/dare\/wp-json\/wp\/v2\/comments?post=578"}],"version-history":[{"count":7,"href":"https:\/\/research.reading.ac.uk\/dare\/wp-json\/wp\/v2\/posts\/578\/revisions"}],"predecessor-version":[{"id":673,"href":"https:\/\/research.reading.ac.uk\/dare\/wp-json\/wp\/v2\/posts\/578\/revisions\/673"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/research.reading.ac.uk\/dare\/wp-json\/wp\/v2\/media\/581"}],"wp:attachment":[{"href":"https:\/\/research.reading.ac.uk\/dare\/wp-json\/wp\/v2\/media?parent=578"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/research.reading.ac.uk\/dare\/wp-json\/wp\/v2\/categories?post=578"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/research.reading.ac.uk\/dare\/wp-json\/wp\/v2\/tags?post=578"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}