Rapid Evaluation Framework for climate simulations
As climate models become increasingly complex, there is a need for systematic and comprehensive evaluation and benchmarking through comparison with best-available observational data to assess model fidelity across a wide range of variables.
Vision for the Rapid Evaluation Framework: A community owned evaluation framework, built upon, and compatible with, existing community evaluation packages that incorporates an application programming interface (API) for executing metrics generated from community evaluation packages, across the globe.
Goal: The CMIP7 Assessment Fast Track Rapid Evaluation Framework (CMIP7 AFT REF) will be a complete end to end system providing a systematic and rapid performance assessment of the expected models participating in the CMIP7 Assessment Fast Track, supporting the seventh IPCC Assessment Report (AR7) cycle.
Outcome: The REF provides the ability to fully integrate evaluation tools into the CMIP publication workflow, and their diagnostic outputs published alongside the model output on the Earth System Grid Federation (ESGF) through an easily accessible website.
Wider community use beyond CMIP: The REF is designed to be a starting point for the community to develop and build upon, with applications across the WCRP Modelling Multiverse and beyond.
See the CMIP AR7 Fast-Track REF announcement for more context.
ESMValTool Core: core functionalities and driver for ESMValTool, a community diagnostic and performance metrics tool for routine evaluation of Earth System Models in CMIP.
The Earth System Model eValuation Tool is a community diagnostics and performance metrics tool for the evaluation of Earth System Models that allows for routine comparison of models and observations.