{"id":2741,"date":"2025-05-28T12:21:30","date_gmt":"2025-05-28T11:21:30","guid":{"rendered":"https:\/\/research.reading.ac.uk\/met-darc\/?p=2741"},"modified":"2025-05-28T12:21:30","modified_gmt":"2025-05-28T11:21:30","slug":"the-value-of-observations-for-weather-prediction-in-the-age-of-machine-learning","status":"publish","type":"post","link":"https:\/\/research.reading.ac.uk\/met-darc\/2025\/05\/28\/the-value-of-observations-for-weather-prediction-in-the-age-of-machine-learning\/","title":{"rendered":"The value of observations for weather prediction in the age of machine learning"},"content":{"rendered":"

by Sarah L Dance<\/p>\n

A few months ago, on 25th<\/sup> February 2025, our colleagues at ECMWF (European Centre for Medium-range Weather Forecasts) took their deep-learning-based global weather forecasting system, known as the AIFS<\/a>, into operational production, running alongside their physics-based numerical weather prediction system. \u00a0The AIFS outperforms state-of-the-art physics-based models for several measures of accuracy, and is computationally much faster to run. However, both systems currently share a need for initialization with a best estimate of the current state of the atmosphere, created using a process called data assimilation<\/strong>.<\/p>\n

Tens of millions of atmospheric observations are used in weather prediction every day, but observations alone can not describe the weather at all points on the globe. To get a complete picture we use data assimilation<\/strong> to optimally combine the observations with information from a physics-based computer model, taking account of our confidence in each source of data. \u00a0The resulting analysis is used as a starting point for both physics-based and machine-learning-based weather forecasts. It is also important to note that reanalysis, using data assimilation with historic observations, is a key component of training data for machine learning forecasting systems.<\/p>\n

\"\"
Schematic of the global observing system from the World Meteorological Organization https:\/\/community.wmo.int\/en\/observation-components-global-observing-system<\/figcaption><\/figure>\n

In recent decades, steady improvements in global numerical weather prediction accuracy have been driven by enhancements to data assimilation methods and increasing volumes of observations assimilated (e.g., Bauer et al, 2015). However, new observations are expensive, with new satellites costing billions of pounds. Thus, investments in such systems are evidence-driven. To inform these financial decisions, data assimilation scientists have traditionally carried out quantitative experiments to estimate the impact of new observations on improving forecasts with physics-based numerical weather prediction systems (e.g., Hu et al, 2025).<\/p>\n

In the age of machine-learning forecasting, the connection between each observation-type and forecast accuracy is less transparent. It is not yet clear how to measure the impact of specific observations on machine learning training, nor initialization of machine learning models. This is a critical question to address to ensure continued improvement in forecast accuracy, and better resilience to hazardous weather events.<\/p>\n

References<\/strong><\/p>\n

Bauer, P., Thorpe, A. & Brunet, G. The quiet revolution of numerical weather prediction.\u00a0Nature<\/em>\u00a0525<\/strong>, 47\u201355 (2015). https:\/\/doi.org\/10.1038\/nature14956<\/a><\/p>\n

Hu, G., Dance, S.L., Fowler, A., Simonin, D., Waller, J., Auligne, T., et al. (2025) On methods for assessment of the value of observations in convection-permitting data assimilation and numerical weather forecasting. Quarterly Journal of the Royal Meteorological Society https:\/\/doi.org\/10.1002\/qj.4933<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

by Sarah L Dance A few months ago, on 25th February 2025, our colleagues at ECMWF (European Centre for Medium-range Weather Forecasts) took their deep-learning-based global weather forecasting system, known…Read More ><\/a><\/p>\n","protected":false},"author":960,"featured_media":2753,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"__cvm_playback_settings":[],"__cvm_video_id":"","footnotes":"","_links_to":"","_links_to_target":""},"categories":[1],"tags":[65,64,63,66],"class_list":["post-2741","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-uncategorised","tag-data-assimilation","tag-machine-learning","tag-numerical-weather-prediction","tag-observation-impact"],"acf":[],"yoast_head":"\nThe value of observations for weather prediction in the age of machine learning - DARC<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/research.reading.ac.uk\/met-darc\/2025\/05\/28\/the-value-of-observations-for-weather-prediction-in-the-age-of-machine-learning\/\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"The value of observations for weather prediction in the age of machine learning - DARC\" \/>\n<meta property=\"og:description\" content=\"by Sarah L Dance A few months ago, on 25th February 2025, our colleagues at ECMWF (European Centre for Medium-range Weather Forecasts) took their deep-learning-based global weather forecasting system, known...Read More >\" \/>\n<meta property=\"og:url\" content=\"https:\/\/research.reading.ac.uk\/met-darc\/2025\/05\/28\/the-value-of-observations-for-weather-prediction-in-the-age-of-machine-learning\/\" \/>\n<meta property=\"og:site_name\" content=\"DARC\" \/>\n<meta property=\"article:published_time\" content=\"2025-05-28T11:21:30+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/research.reading.ac.uk\/met-darc\/wp-content\/uploads\/sites\/48\/2025\/05\/pexels-spacex-23781-scaled.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"2560\" \/>\n\t<meta property=\"og:image:height\" content=\"1707\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Guannan Hu\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Guannan Hu\" \/>\n\t<meta name=\"twitter:label2\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/research.reading.ac.uk\/met-darc\/2025\/05\/28\/the-value-of-observations-for-weather-prediction-in-the-age-of-machine-learning\/\",\"url\":\"https:\/\/research.reading.ac.uk\/met-darc\/2025\/05\/28\/the-value-of-observations-for-weather-prediction-in-the-age-of-machine-learning\/\",\"name\":\"The value of observations for weather prediction in the age of machine learning - DARC\",\"isPartOf\":{\"@id\":\"https:\/\/research.reading.ac.uk\/met-darc\/#website\"},\"datePublished\":\"2025-05-28T11:21:30+00:00\",\"dateModified\":\"2025-05-28T11:21:30+00:00\",\"author\":{\"@id\":\"https:\/\/research.reading.ac.uk\/met-darc\/#\/schema\/person\/41beca464c9b27182f6155ebedd0b117\"},\"breadcrumb\":{\"@id\":\"https:\/\/research.reading.ac.uk\/met-darc\/2025\/05\/28\/the-value-of-observations-for-weather-prediction-in-the-age-of-machine-learning\/#breadcrumb\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/research.reading.ac.uk\/met-darc\/2025\/05\/28\/the-value-of-observations-for-weather-prediction-in-the-age-of-machine-learning\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/research.reading.ac.uk\/met-darc\/2025\/05\/28\/the-value-of-observations-for-weather-prediction-in-the-age-of-machine-learning\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/research.reading.ac.uk\/met-darc\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"The value of observations for weather prediction in the age of machine learning\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/research.reading.ac.uk\/met-darc\/#website\",\"url\":\"https:\/\/research.reading.ac.uk\/met-darc\/\",\"name\":\"DARC\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/research.reading.ac.uk\/met-darc\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-GB\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/research.reading.ac.uk\/met-darc\/#\/schema\/person\/41beca464c9b27182f6155ebedd0b117\",\"name\":\"Guannan Hu\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\/\/research.reading.ac.uk\/met-darc\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/4aa971b56d7b1b1c4fcafa11a08255d399ccc0a8fa28c704cc54aaa0aa08907d?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/4aa971b56d7b1b1c4fcafa11a08255d399ccc0a8fa28c704cc54aaa0aa08907d?s=96&d=mm&r=g\",\"caption\":\"Guannan Hu\"},\"url\":\"https:\/\/research.reading.ac.uk\/met-darc\/author\/sj922391reading-ac-uk\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"The value of observations for weather prediction in the age of machine learning - DARC","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/research.reading.ac.uk\/met-darc\/2025\/05\/28\/the-value-of-observations-for-weather-prediction-in-the-age-of-machine-learning\/","og_locale":"en_GB","og_type":"article","og_title":"The value of observations for weather prediction in the age of machine learning - DARC","og_description":"by Sarah L Dance A few months ago, on 25th February 2025, our colleagues at ECMWF (European Centre for Medium-range Weather Forecasts) took their deep-learning-based global weather forecasting system, known...Read More >","og_url":"https:\/\/research.reading.ac.uk\/met-darc\/2025\/05\/28\/the-value-of-observations-for-weather-prediction-in-the-age-of-machine-learning\/","og_site_name":"DARC","article_published_time":"2025-05-28T11:21:30+00:00","og_image":[{"width":2560,"height":1707,"url":"https:\/\/research.reading.ac.uk\/met-darc\/wp-content\/uploads\/sites\/48\/2025\/05\/pexels-spacex-23781-scaled.jpg","type":"image\/jpeg"}],"author":"Guannan Hu","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Guannan Hu","Estimated reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/research.reading.ac.uk\/met-darc\/2025\/05\/28\/the-value-of-observations-for-weather-prediction-in-the-age-of-machine-learning\/","url":"https:\/\/research.reading.ac.uk\/met-darc\/2025\/05\/28\/the-value-of-observations-for-weather-prediction-in-the-age-of-machine-learning\/","name":"The value of observations for weather prediction in the age of machine learning - DARC","isPartOf":{"@id":"https:\/\/research.reading.ac.uk\/met-darc\/#website"},"datePublished":"2025-05-28T11:21:30+00:00","dateModified":"2025-05-28T11:21:30+00:00","author":{"@id":"https:\/\/research.reading.ac.uk\/met-darc\/#\/schema\/person\/41beca464c9b27182f6155ebedd0b117"},"breadcrumb":{"@id":"https:\/\/research.reading.ac.uk\/met-darc\/2025\/05\/28\/the-value-of-observations-for-weather-prediction-in-the-age-of-machine-learning\/#breadcrumb"},"inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/research.reading.ac.uk\/met-darc\/2025\/05\/28\/the-value-of-observations-for-weather-prediction-in-the-age-of-machine-learning\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/research.reading.ac.uk\/met-darc\/2025\/05\/28\/the-value-of-observations-for-weather-prediction-in-the-age-of-machine-learning\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/research.reading.ac.uk\/met-darc\/"},{"@type":"ListItem","position":2,"name":"The value of observations for weather prediction in the age of machine learning"}]},{"@type":"WebSite","@id":"https:\/\/research.reading.ac.uk\/met-darc\/#website","url":"https:\/\/research.reading.ac.uk\/met-darc\/","name":"DARC","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/research.reading.ac.uk\/met-darc\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-GB"},{"@type":"Person","@id":"https:\/\/research.reading.ac.uk\/met-darc\/#\/schema\/person\/41beca464c9b27182f6155ebedd0b117","name":"Guannan Hu","image":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/research.reading.ac.uk\/met-darc\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/4aa971b56d7b1b1c4fcafa11a08255d399ccc0a8fa28c704cc54aaa0aa08907d?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/4aa971b56d7b1b1c4fcafa11a08255d399ccc0a8fa28c704cc54aaa0aa08907d?s=96&d=mm&r=g","caption":"Guannan Hu"},"url":"https:\/\/research.reading.ac.uk\/met-darc\/author\/sj922391reading-ac-uk\/"}]}},"cc_featured_image_caption":{"caption_text":"","source_text":"","source_url":""},"_links":{"self":[{"href":"https:\/\/research.reading.ac.uk\/met-darc\/wp-json\/wp\/v2\/posts\/2741","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/research.reading.ac.uk\/met-darc\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/research.reading.ac.uk\/met-darc\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/research.reading.ac.uk\/met-darc\/wp-json\/wp\/v2\/users\/960"}],"replies":[{"embeddable":true,"href":"https:\/\/research.reading.ac.uk\/met-darc\/wp-json\/wp\/v2\/comments?post=2741"}],"version-history":[{"count":4,"href":"https:\/\/research.reading.ac.uk\/met-darc\/wp-json\/wp\/v2\/posts\/2741\/revisions"}],"predecessor-version":[{"id":2746,"href":"https:\/\/research.reading.ac.uk\/met-darc\/wp-json\/wp\/v2\/posts\/2741\/revisions\/2746"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/research.reading.ac.uk\/met-darc\/wp-json\/wp\/v2\/media\/2753"}],"wp:attachment":[{"href":"https:\/\/research.reading.ac.uk\/met-darc\/wp-json\/wp\/v2\/media?parent=2741"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/research.reading.ac.uk\/met-darc\/wp-json\/wp\/v2\/categories?post=2741"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/research.reading.ac.uk\/met-darc\/wp-json\/wp\/v2\/tags?post=2741"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}