Gaps in data and difficult‑to‑compare datasets limit what climate and weather AI models can reliably predict. Researchers from the ETH Domain have now introduced an AI model that helps close these gaps, reconstructs satellite images, and sheds light on how weather, land and water interact.
The impacts were severe: Within a very short time, tropical storm Doksuri intensified into a super typhoon in July 2023. Exceptionally strong winds tore roofs from houses along the coasts of China and the Philippines, trees were uprooted, and torrential rain flooded streets and residential areas. In many places, everyday life came to a temporary halt.
Extreme events such as Super Typhoon Doksuri are particularly difficult for weather and climate models to predict, as they arise from complex interactions between the atmosphere, the land surface and the water cycle.
Researchers from the ETH Domain have now introduced a new artificial intelligence (AI) model that has learned these interactions and feedback autonomously – without human guidance – and, compared to previous AI models, more precisely captures how air, land and water interact on Earth.
AI understands the key connections within the Earth system
The new Earth System Foundation Model (ESFM) does not treat atmospheric and hydrological (i.e. water-related) processes in isolation, but rather represents them as part of an interconnected Earth system.
“Previous AI weather models have often focussed primarily on the atmosphere. Our model, by contrast, deliberately links atmospheric weather data with hydrological and land-based data. On this basis, the AI identifies key patterns, trends and relationships within the Earth’s weather system and uses them to generate forecasts, even when important data is missing,” explains Fanny Lehmann, mathematician, ETH AI Center Postdoctoral Fellow, and member of the team that developed the new model.
“The true strength of our model lies in its ability to learn the interactions that are crucial for weather from different data sources. This allows ESFM to integrate very different and hard‑to‑compare data types and to analyse them jointly for the first time.”
The researchers tested their model using Super Typhoon Doksuri as a case study. This tropical storm was not part of the training data. Even so, ESFM predicted wind strength with remarkable accuracy over several days and simultaneously captured realistically where the storm was, how quickly it moved, and how it expanded in space. This demonstrated how effectively the new model can jointly process very large, complex and heterogeneous datasets.
Learning from incomplete and heterogeneous data
The integrative approach of ESFM addresses a need in climate and environmental sciences. In research practice, data often varies considerably: some comes from satellite imagery, some from weather balloons, ground‑based stations, or other sensors. This data ranges from very fine-grained, short‑term measurements to large‑scale, long‑term observations.
Data types also differ markedly. While satellite imagery and climate models provide data in the form of large‑scale raster maps, ground stations or wells record key variables such as temperature, air pressure, wind speed or water levels at specific locations and at defined points in time.
To integrate these different types of environmental data, ESFM follows a multi‑stage approach: rather than forcing all data types into a single format from the outset, it initially treats them separately, depending on their type – whether satellite or station data – and tags them with information on when and where they were measured.
This approach enables the combination of very different data within a common spatial and temporal framework, while preserving its specific information. On this basis, the model learns the typical, recurring process chains and fundamental relationships within the Earth system.
Maintaining performance even when data is missing
“Earlier AI models for weather forecasting – unlike ESFM – were often trained on a single type of data or on a few datasets of a similarly formatted nature,” explains Firat Ozdemir, lead developer of the ESFM team and Senior Data Scientist at the joint Swiss Data Science Center of ETH Zurich and EPFL. “Their performance often declines when working with highly heterogeneous or incomplete data. ESFM addresses this challenge by integrating multi-source data and filling data gaps much more efficiently.”
“ESFM is neither a classical climate model nor a weather forecasting or specialised storm‑warning model; rather, it belongs to a distinct category of models that can serve as a flexible foundation for a wide range of tasks in climate and weather research,” says Sebastian Schemm, atmospheric scientist and professor at the University of Cambridge, formerly at ETH Zurich.
“Its advantage lies in a kind of learned systemic understanding that enables it to produce plausible predictions in many cases, even when data is incomplete or patchy.”
Designed to bridge data gaps intelligently
Such data gaps significantly hindered previous AI models in analysing and predicting complex weather and water phenomena. However, in research practice, it is not uncommon for individual measurements to be lost or compromised due to weather conditions or technical issues. Measurement networks, too, often contain gaps, as monitoring stations are unevenly distributed.
ESFM, by contrast, is specifically designed to cope with missing data and to internally reconstruct incomplete observations, such as patchy satellite images. After training, the model succeeds in generating forecasts from satellite observations in which only around 3 percent of the pixels are available.
The researchers, including Benedikt Soja, Professor of Space Geodesy at ETH Zurich, showed that their model can reliably fill data gaps both in weather station data and in the long-term global ERA5 dataset. On this basis, it is able to generate plausible forecasts of weather conditions.
Building on many learned examples of how the atmosphere, land and water are interconnected, ESFM can plausibly complete patchy satellite images with information such as temperature, humidity, soil type, whether an area is land or sea, and topography.
The model systematically embeds this information within the processes that link, for example, rainfall, soil moisture and groundwater, thereby helping to improve the understanding of droughts and potentially making them easier to predict.
ESFM infers missing measurement data by relating data gaps to other available data sources and to patterns it has learned from similar situations in neighbouring regions, from related variables, and from past observations.
Learning is more than repetition
“Through training on very different types of data, models such as ESFM acquire a form of fundamental knowledge and can therefore flexibly solve a wide range of tasks. In AI research, they are referred to as foundation models,” says Torsten Hoefler, Professor of Computer Science at ETH Zurich, who also serves as Chief AI Architect at the Swiss National Supercomputing Centre (CSCS) in Lugano, where he oversees research on new AI approaches (see box).
Like all foundation models, ESFM can be used for a range of tasks and can also be adapted to specific applications through a process known as finetuning. The team’s research shows that ESFM applies fundamental physical principles consistently and reliably – even when addressing new physical or weather‑related questions or working with variables for which it was not explicitly trained.
In the future, ESFM or especially finetuned versions have the potential to provide reliable forecasts of weather and water processes. “We intend to leverage the model’s representational power across diverse domains such as agriculture, biodiversity and hydrology,” says Mathieu Salzmann, Senior Scientist at EPFL and Deputy Chief Data Scientist at the Swiss Data Science Center (SDSC).
Swiss AI Initiative, ICAIN and download
ESFM was developed within the Weather and Climate Foundation Models project, which is part of the Swiss AI Initiative. The project also includes ETH Zurich mathematics professor Siddhartha Mishra. Within this framework, researchers from ETH Zurich, EPFL and other partners are developing foundation models addressing key challenges in Switzerland.
ESFM is also supported by the International Computation and AI Network (ICAIN) at ETH Zurich. The network promotes international AI collaboration and works to ensure that such foundation models can be used in the Global South. Within the ESFM project, ICAIN helps identify partners in data‑sparse regions to enable finetuning of the model with local data.
ESFM is freely available on the AI platform Hugging Face and in the Git repository.
Reference
Ozdemir, F., Cheng, Y., Mohebi, S., Lehmann, F., Adamov, S., Trentini, L., Huang, L., Lingsch, L., Zhang, Z., Fuhrer, O., Soja, B., Mishra, S., Hoefler, T., Schemm, S., and Salzmann, M.: ESFM – A foundation model framework for heterogeneous data integration. EGU General Assembly 2026, Vienna, Austria, 3–8 May 2026, EGU26-18011. DOI: 10.5194/egusphere-egu26-18011.
Earth System Foundation Model (ESFM): A Unified Framework for Heterogeneous Data Integration and Forecasting: https://arxiv.org/abs/2605.00850
Finetuning a Weather Foundation Model with Lightweight Decoders for Unseen Physical Processes: https://arxiv.org/abs/2506.19088
Article by: Florian Meyer, ETH Zurich
