ESMValTool

The Earth System Model eValuation Tool is a community diagnostics and performance metrics tool for the evaluation of Earth System Models that allows for routine comparison of models and observations.

245
mentions
81
contributors

Cite this software

What ESMValTool can do for you

  • Facilitates the complex evaluation of ESMs and their simulations submitted to international Model Intercomparison Projects (e.g., CMIP).
  • Standardized model evaluation can be performed against observations, against other models or to compare different versions of the same model.
  • Wide scope: includes many diagnostics and performance metrics covering different aspects of the Earth System (dynamics, radiation, clouds, carbon cycle, chemistry, aerosol, sea-ice, etc.) and their interactions.
  • Well-established analysis: standard recipes reproduce specific sets of diagnostics or performance metrics that have demonstrated their importance in ESM evaluation in the peer-reviewed literature.
  • High flexibility: new diagnostics and more observational data can be easily added.
  • Multi-language support: Python, NCL, R, Julia... other open-source languages are possible.
  • CF/CMOR compliant: data from many different projects can be handled (CMIP, obs4mips, ana4mips, CCMI, CCMVal, AEROCOM, etc.). Routines are provided to CMOR-ize non-compliant data.
  • Integration in modeling workflows: for EMAC, NOAA-GFDL and NEMO, can be easily extended.

The Earth System Model eValuation Tool (ESMValTool) is a community diagnostics and performance metrics tool for the evaluation of Earth System Models (ESMs) that allows for routine comparison of single or multiple models, either against predecessor versions or against observations. The priority of the effort so far has been to target specific scientific themes focusing on selected Essential Climate Variables, a range of known systematic biases common to ESMs, such as coupled tropical climate variability, monsoons, Southern Ocean processes, continental dry biases and soil hydrology-climate interactions, as well as atmospheric CO2 budgets, tropospheric and stratospheric ozone, and tropospheric aerosols. The tool is being developed in such a way that additional analyses can easily be added. A set of standard recipes for each scientific topic reproduces specific sets of diagnostics or performance metrics that have demonstrated their importance in ESM evaluation in the peer-reviewed literature. The ESMValTool is a community effort open to both users and developers encouraging open exchange of diagnostic source code and evaluation results from the CMIP ensemble. This will facilitate and improve ESM evaluation beyond the state-of-the-art and aims at supporting such activities within the Coupled Model Intercomparison Project (CMIP) and at individual modeling centers. Ultimately, we envisage running the ESMValTool alongside the Earth System Grid Federation (ESGF) as part of a more routine evaluation of CMIP model simulations while utilizing observations available in standard formats (obs4MIPs) or provided by the user.

Logo of ESMValTool
Keywords
Programming languages
  • NCL 49%
  • Python 40%
  • R 7%
  • Emacs Lisp 2%
  • TeX 2%
License
  • Apache-2.0
</>Source code
Packages
anaconda.org
pypi.org
hub.docker.com

Participating organisations

Alfred Wegener Institute
Barcelona Supercomputing Center
CMCC
DLR
ETH Zurich
Ludwig Maximilian University of Munich
Met Office
Plymouth Marine Laboratory
Swedish Meteorological and Hydrological Institute
Environment & Sustainability
Environment & Sustainability
University of Reading
University of Bremen
Netherlands eScience Center

Reference papers

Mentions

ESMValTool: Recipes for solid climate science

Author(s): Peter Kalverla, Bouwe Andela
Published by Netherlands eScience Center in 2023

The new IPCC assessment report: stakes have been raised

Author(s): Gijs van den Oord
Published in 2021

Contributors

Related projects

ESiWACE3

Centre of Excellence in Simulation of Weather and Climate in Europe

Updated 9 months ago
In progress

ESMValTool Knowledge Development

Netherlands eScience Center Knowledge Development project aiming to promote the use of ESMValTool and optimize its computational performance.

Updated 5 months ago
Finished

IS-ENES3

Providing the infrastructure to better understand and project climate variability and change

Updated 15 months ago
Finished

eWaterCycle II

Overcoming the challenge of locality using a community multi-model environment

Updated 15 months ago
Finished

EUropean Climate Prediction system (EUCP)

An innovative European regional ensemble climate prediction system

Updated 12 months ago
Finished

MAGIC

Metrics and Access to Global Indices for Climate Projections

Updated 15 months ago
Finished

PRIMAVERA

Process-based climate simulation: advances in high-resolution modelling and European climate risk...

Updated 11 months ago
Finished

Related software

ESMValCore

ES

ESMValTool Core: core functionalities and driver for ESMValTool, a community diagnostic and performance metrics tool for routine evaluation of Earth System Models in CMIP.

Updated 5 months ago
67 40