| Title: |
Rapid evaluation framework for the CMIP7 assessment fast track |
| Authors: |
Hoffman, Forrest M.; Hassler, Birgit; Swaminathan, Ranjini; Lewis, Jared; Andela, Bouwe; Collier, Nathaniel; Hegedűs, Dóra; Lee, Jiwoo; Pascoe, Charlotte; Pflüger, Mika; Stockhause, Martina; Ullrich, Paul; Xu, Min; Bock, Lisa; Chun, Felicity; Gier, Bettina K.; Kelley, Douglas I.; Lauer, Axel; Lenhardt, Julien; Schlund, Manuel; Sreeush, Mohanan G.; Weigel, Katja; Blockley, Ed; Beadling, Rebecca; Beucher, Romain; Dugassa, Demiso D.; Lembo, Valerio; Lu, Jianhua; Brands, Swen; Tjiputra, Jerry; Malinina, Elizaveta; Mederios, Brian; Scoccimarro, Enrico; Walton, Jeremy; Kershaw, Philip; Marquez, André L.; Roberts, Malcolm J.; O’Rourke, Eleanor; Dingley, Elisabeth; Turner, Briony; Hewitt, Helene; Dunne, John P. |
| Publisher Information: |
European Geosciences Union |
| Publication Year: |
2025 |
| Collection: |
Natural Environment Research Council: NERC Open Research Archive |
| Subject Terms: |
Earth Sciences; Data and Information |
| Description: |
As Earth system models (ESMs) grow in complexity and in volumes of output data, there is an increasing need for rapid, comprehensive evaluation of their scientific performance. The upcoming Assessment Fast Track for the Seventh Phase of the Coupled Model Intercomparison Project (CMIP7) will require expeditious response for model analyses designed to inform and drive integrated Earth system assessments. To meet this challenge, the Rapid Evaluation Framework (REF), a community-driven platform for benchmarking and performance assessment of ESMs, was designed and developed. The initial implementation of the REF, constructed to meet the near-term needs of the CMIP7 Assessment Fast Track, builds upon community evaluation and benchmarking tools. The REF runs within a containerized workflow for portability and reproducibility and is aimed at generating and organizing diagnostics covering a variety of model variables. The REF leverages best-available observational datasets to provide assessments of model fidelity across a collection of diagnostics. All diagnostics were identified and finally selected with community involvement and consultation. Operational integration with the Earth System Grid Federation (ESGF) will permit automated execution of the REF for specific diagnostics as soon as model data are published on ESGF by the originating modelling centres. The REF is designed to be portable across a range of current computational platforms to facilitate use by modelling centres for assessing the evolution of model versions or gauging the relative performance of CMIP simulations before being published on ESGF. When integrated into production simulation workflows, results from the REF provide immediate quantitative feedback that allows model developers and scientists to quickly identify model biases and performance issues. After the REF is released to the community, its subsequent development and support will be prioritized by an international consortium of scientists and engineers, enabling a broader impact across ... |
| Document Type: |
article in journal/newspaper |
| File Description: |
text |
| Language: |
English |
| Relation: |
https://nora.nerc.ac.uk/id/eprint/539911/1/egusphere-2025-2685.pdf; Hoffman, Forrest M. orcid:0000-0001-5802-4134; Hassler, Birgit orcid:0000-0003-2724-709X; Swaminathan, Ranjini orcid:0000-0001-5853-2673; Lewis, Jared; Andela, Bouwe orcid:0000-0001-9005-8940; Collier, Nathaniel; Hegedűs, Dóra orcid:0009-0000-8304-513X; Lee, Jiwoo orcid:0000-0002-0016-7199; Pascoe, Charlotte orcid:0000-0002-2361-6778; Pflüger, Mika orcid:0000-0002-7814-8916; Stockhause, Martina orcid:0000-0001-6636-4972; Ullrich, Paul; Xu, Min; Bock, Lisa orcid:0000-0001-7058-5938; Chun, Felicity orcid:0009-0007-0845-0953; Gier, Bettina K. orcid:0000-0002-2928-8664; Kelley, Douglas I. orcid:0000-0003-1413-4969; Lauer, Axel orcid:0000-0002-9270-1044; Lenhardt, Julien orcid:0000-0002-9949-3989; Schlund, Manuel orcid:0000-0001-5251-0158; Sreeush, Mohanan G. orcid:0000-0003-3720-5408; Weigel, Katja orcid:0000-0001-6133-7801; Blockley, Ed orcid:0000-0002-0489-4238; Beadling, Rebecca; Beucher, Romain orcid:0000-0003-3891-5444; Dugassa, Demiso D. orcid:0000-0002-8431-2575; Lembo, Valerio orcid:0000-0001-6085-5914; Lu, Jianhua orcid:0000-0002-8241-3356; Brands, Swen orcid:0000-0002-3254-0277; Tjiputra, Jerry orcid:0000-0002-4600-2453; Malinina, Elizaveta orcid:0000-0002-4102-2877; Mederios, Brian orcid:0000-0003-2188-4784; Scoccimarro, Enrico orcid:0000-0001-7987-4744; Walton, Jeremy orcid:0000-0001-7372-178X; Kershaw, Philip orcid:0000-0002-7646-291X; Marquez, André L. orcid:0000-0001-8719-8045; Roberts, Malcolm J.; O’Rourke, Eleanor; Dingley, Elisabeth; Turner, Briony orcid:0000-0003-3390-3831; Hewitt, Helene orcid:0000-0001-7432-6001; Dunne, John P. 2025 Rapid evaluation framework for the CMIP7 assessment fast track. EGUsphere, egusphere-2025-2685. 10.5194/egusphere-2025-2685 |
| DOI: |
10.5194/egusphere-2025-2685 |
| Availability: |
https://nora.nerc.ac.uk/id/eprint/539911/; https://doi.org/10.5194/egusphere-2025-2685 |
| Rights: |
cc_by_4 |
| Accession Number: |
edsbas.DCA90F91 |
| Database: |
BASE |