ESMValTool

The Earth System Model eValuation Tool is a community diagnostics and performance metrics tool for the evaluation of Earth System Models that allows for routine comparison of models and observations.

80
mentions
84
contributors

Cite this software

DOI:

10.5281/zenodo.3401363

What ESMValTool can do for you

  • Facilitates the complex evaluation of ESMs and their simulations submitted to international Model Intercomparison Projects (e.g., CMIP).
  • Standardized model evaluation can be performed against observations, against other models or to compare different versions of the same model.
  • Wide scope: includes many diagnostics and performance metrics covering different aspects of the Earth System (dynamics, radiation, clouds, carbon cycle, chemistry, aerosol, sea-ice, etc.) and their interactions.
  • Well-established analysis: standard recipes reproduce specific sets of diagnostics or performance metrics that have demonstrated their importance in ESM evaluation in the peer-reviewed literature.
  • High flexibility: new diagnostics and more observational data can be easily added.
  • Multi-language support: Python, NCL, R, Julia... other open-source languages are possible.
  • CF/CMOR compliant: data from many different projects can be handled (CMIP, obs4mips, ana4mips, CCMI, CCMVal, AEROCOM, etc.). Routines are provided to CMOR-ize non-compliant data.
  • Integration in modeling workflows: for EMAC, NOAA-GFDL and NEMO, can be easily extended.

The Earth System Model eValuation Tool (ESMValTool) is a community diagnostics and performance metrics tool for the evaluation of Earth System Models (ESMs) that allows for routine comparison of single or multiple models, either against predecessor versions or against observations. The priority of the effort so far has been to target specific scientific themes focusing on selected Essential Climate Variables, a range of known systematic biases common to ESMs, such as coupled tropical climate variability, monsoons, Southern Ocean processes, continental dry biases and soil hydrology-climate interactions, as well as atmospheric CO2 budgets, tropospheric and stratospheric ozone, and tropospheric aerosols. The tool is being developed in such a way that additional analyses can easily be added. A set of standard recipes for each scientific topic reproduces specific sets of diagnostics or performance metrics that have demonstrated their importance in ESM evaluation in the peer-reviewed literature. The ESMValTool is a community effort open to both users and developers encouraging open exchange of diagnostic source code and evaluation results from the CMIP ensemble. This will facilitate and improve ESM evaluation beyond the state-of-the-art and aims at supporting such activities within the Coupled Model Intercomparison Project (CMIP) and at individual modeling centers. Ultimately, we envisage running the ESMValTool alongside the Earth System Grid Federation (ESGF) as part of a more routine evaluation of CMIP model simulations while utilizing observations available in standard formats (obs4MIPs) or provided by the user.

Keywords
  • Big data
  • Optimized data handling
  • Visualization
  • Workflow technologies
Programming language
  • NCL 47%
  • Python 41%
  • R 8%
  • Emacs Lisp 2%
  • TeX 2%
License
  • Apache-2.0
</>Source code

Participating organisations

Alfred Wegener Institute
Barcelona Supercomputing Center
CMCC
DLR
ETH Zurich
Ludwig Maximilian University of Munich
Met Office
Netherlands eScience Center
Plymouth Marine Laboratory
Swedish Meteorological and Hydrological Institute
University of Bremen
University of Reading

Mentions

The new IPCC assessment report: stakes have been raised

Author(s): Gijs van den Oord
Published in 2021

Contributors

Contact person

Bouwe Andela

Bouwe Andela

Netherlands eScience Center
Mail Bouwe
ASS
Abel Soares Siqueira
AS
Alistair Sellar
Met Office
AL
Axel Lauer
DLR
BV
Barbara Vreede
Netherlands eScience Center
BC
Bas Crezee
ETH Zurich
BM
Benjamin Müller
Ludwig Maximilian University of Munich
BM
Benjamin Mueller
LMU, Germany
BG
Bettina Gier
University of Bremen
BL
Bill Little
MetOffice, UK
BH
Birgit Hassler
DLR
BB
Bjoern Broetz
DLR, Germany
BB
Björn Brötz
DLR
Bouwe Andela
Bouwe Andela
Netherlands eScience Center
BSF
Breixo Solino Fernandez
DLR
CE
Carsten Ehbrecht
DKRZ, Germany
CR
Charles Roberts
CM
Christian Wilhelm Mohr
CK
Christopher Kadow
FUB, Germany
CD
Clara Deser
NCAR, USA
DS
Daniel Senftleben
DLR, Germany
DD
David Docquier
UCLouvain, Belgium
ED
Edouard Leopold Davin
EM
Eduardo Moreno-Chamarro
BSC, Spain
EA
Enrico Arnone
CNR-ISAC
FA
Fakhereh Alidoost
Netherlands eScience Center
Faruk Diblen
Faruk Diblen
Netherlands eScience Center
FM
François Massonnet
UCLouvain, Belgium
Inti Pelupessy
Inti Pelupessy
Netherlands eScience Center
JS
Jana Sillmann
CICERO, Norway
Jaro Camphuijsen
Jaro Camphuijsen
Netherlands eScience Center
JV
Javier Vegas-Regidor
Barcelona Supercomputing Center
JA
Jerom Aerts
Delft University of Technology
JR
Joellen Russell
University of Arizona, USA
JvH
Jost von Hardenberg
CNR-ISAC
KW
Katja Weigel
University of Bremen
KA
Kemisola Adeniyi
University of Bremen, Germany
KZ
Klaus Zimmermann
Swedish Meteorological and Hydrological Institute
LD
Laura Dreyer
MetOffice, UK
LdM
Lee de Mora
Plymouth Marine Laboratory
LL
Llorenç Lledó
BSC, Spain
LB
Lukas Brunner
ETH Zurich
MS
Manuel Schlund
DLR
MS
Marit Sandstad
CICERO, Norway
MJ
Martin Jury
Barcelona Supercomputing Center
MR
Mattia Righi
DLR
Niels  Drost
Niels Drost
Netherlands eScience Center
NK
Nikolay Koldunov
Alfred Wegener Institute
NG
NC
Nuno Carvalhais
MPI for Biogeochemistry, Germany
NP
Nuria Pérez-Zanón
Barcelona Supercomputing Center
NP
Núria Pérez-Zanón
BSC, Spain
PA
Pandde Amarjiit
University of Arizona, USA
PG
Paul Goodman
University of Arizona, USA
PE
Paul Earnshaw
MetOffice, UK
Peter Kalverla
Peter Kalverla
Netherlands eScience Center
QL
Quentin Lejeune
ETH Zurich, Switzerland
RS
Ranjini Swaminathan
University of Reading
RL
Ruth Lorenz
ETH Zurich
RK
Rémi Kazeroni
DLR
SL
Saskia Loosveldt-Tomas
Barcelona Supercomputing Center
Stef Smeets
Stef Smeets
Netherlands eScience Center
Stefan Verhoeven
Stefan Verhoeven
Netherlands eScience Center
SK
Sujan Koirala
MPI for Biogeochemistry, Germany
SC
Susanna Corti
ISAC-CNR, Italy
TS
Tobias Stacke
Helmholz-Zentrum Hereon
TL
Tomas Lovato
CMCC
VL
Valerio Lembo
VL
Valerio Lucarini
University of Hamburg, German
VP
Valeriu Predoi
University of Reading
VE
Veronika Eyring
DLR
VT
Verónica Torralba
BSC, Spain
Yifat Dzigan
Yifat Dzigan
Netherlands eScience Center

Related projects

IS-ENES3

Providing the infrastructure to better understand and project climate variability and change

Updated 2 months ago
Running

eWaterCycle II

Overcoming the challenge of locality using a community multi-model environment

Updated 2 months ago
Running

EUropean Climate Prediction system (EUCP)

An innovative European regional ensemble climate prediction system

Updated 2 months ago
Finished

MAGIC

Metrics and Access to Global Indices for Climate Projections

Updated 2 months ago
Finished

Related tools

ESMValCore

ES

ESMValTool Core: core functionalities and driver for ESMValTool, a community diagnostic and performance metrics tool for routine evaluation of Earth System Models in CMIP.

Updated 2 months ago
35 mentions, 41 contributors