Pasar al contenido principal

DATA MANAGEMENT AND ANALYSIS FOR CLIMATE SERVICES

PRE2021-097646

•
Nombre agencia financiadora Agencia Estatal de Investigación
Acrónimo agencia financiadora AEI
Programa Programa Estatal para Desarrollar, Atraer y Retener Talento
Subprograma Subprograma Estatal de Formación
Convocatoria Contratos Predoctorales
Año convocatoria 2021
Plan Estatal 2021-2023 Plan Estatal de Investigación Científica y Técnica y de Innovación
Centro beneficiario AGENCIA ESTATAL CONSEJO SUPERIOR DE INVESTIGACIONES CIENTIFICAS (CSIC)

Resultados relacionados

Resultados totales (Incluyendo duplicados): 5
Encontrada(s) 1 página(s)

DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

The Earth System Grid Federation (ESGF) Virtual Aggregation (CMIP6 v20240125)

  • Cimadevilla, Ezequiel
  • Lawrence, Bryan N.
  • Cofiño, Antonio S.
The Earth System Grid Federation (ESGF) holds several petabytes of climate data distributed across millions of files held in data centres worldwide. The processes of obtaining and manipulating the scientific information (climate variables) held in these files are non-trivial. The ESGF Virtual Aggregation is one of several solutions to provide an out-of-the-box aggregated and analysis-ready view of those variables. Here, we discuss the ESGF Virtual Aggregation in the context of the existing infrastructure and some of those other solutions providing analysis-ready data. We describe how it is constructed, how it can be used, and its benefits for model evaluation data analysis tasks, and we provide some performance evaluation. It will be seen that the ESGF Virtual Aggregation provides a sustainable solution to some of the problems encountered in producing analysis-ready data without the cost of data replication to different formats, albeit at the cost of more data movement within the analysis compared to some alternatives. If heavily used, it may also require more ESGF data servers than are currently deployed in data node deployments. The need for such data servers should be a component of ongoing discussions about the future of the ESGF and its constituent core services., The PhD grant that supported this study (grant no. PRE2021-097646) was funded by MICIU/AEI/10.13039/501100011033 and by ESF., The article processing charges for this open-access publication were covered by the CSIC Open Access Publication Support Initiative through its Unit of Information Resources for Research (URICI)., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Why the relational data model matters for climate data management

  • Cimadevilla, Ezequiel
Efficient data management of climate data banks, in particular those generated by Global or Regional Climate Models, is an important requirement for precise understanding of current changes in the climate system. Current data management practices in the climate community are based on the analysis of binary files for storage of multidimensional arrays that require ad hoc software libraries for accessing the data. Several approaches are being developed to ease and facilitate climate data management and data analysis. However, the theoretical foundations that cause climate data manipulation difficulties remain unchallenged. The Relational Data Model was proposed as a formal solution for database management based on mathematical logic. It has been widely accepted in the industry and has survived the test of time. However, the foundational principles of the Relational Data Model have been overlooked by the climate data management community, mostly due to a lack of emphasis in the relevance of mathematical logic for database management and misunderstanding between physical and logical levels of abstraction. As a result, climate data management workflows lack the rigor and formality provided by the Relational Data Model. This work explains the Relational Data Model at the logical level of abstraction and provides the arguments, clarifies the misconceptions, and justifies its adoption for climate data management in the context of gridded data generated by climate models., This work was supported by Ph.D. grant PRE2021-097646 funded by MICIU/AEI/10.13039/501100011033 and by ESF+ ., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Predictability of semiannual atmospheric circulation type frequencies in the extratropics using the EC-earth3 decadal forecasting system

  • Brands, Swen
  • Cimadevilla, Ezequiel
  • Fernández, Jesús
We investigate the skill of the fully initialized decadal forecasting system EC-Earth3 in re-forecasting the semiannual occurrence frequencies of synoptic-scale atmospheric circulation types in the extratropics. Six-hourly sea-level pressure data from 10 model integrations of the dcppA-hindcast experiment are transformed into discrete circulation-type time series using the Jenkinson-Collison approach. The frequencies of these types are then compared to those derived from a reference reanalysis. The resulting skill is assessed and compared to that of a 10-member ensemble run with historical forcing to evaluate the added value of initialization. In the Pacific-North American sector, both the skill and added value are significant for the December-to-May season of the first forecast year. In the Southern Hemisphere, significant results are found for the same season through the second forecast year and also for the June-to-November season of the first forecast year. Significant signal-to-noise paradox situations are virtually absent in the analyses conducted here., [Plain Language Summary] This work is a pilot study on the near-term climate predictability of semiannual weather type frequencies in the extratropics, derived from sub-daily model and reanalysis data, which are primarily influenced by atmospheric noise. Contrary to expectations, significant predictability is found in both hemispheres up to 13 months in advance, particularly during the December-to-May season. At this forecast horizon, observation-based model initialization provides added value in most regions globally, including some where the actual skill is not significant. We conclude that decadal predictions are more suitable for making operational forecast decisions regarding atmospheric circulation than previously thought., This work has received funding from the European Union's Horizon Europe research and innovation programme under grant agreement No 101081555 (IMPETUS4CHANGE). SB acknowledges support by the Spanish MITECO and European Commission NextGenerationEU (Regulation EU 2020/2094), through CSIC's PTI-Clima. EC acknowledges support from Grant PRE2021-097646, funded by MICIU/AEI/10.13039/501100011033 and by ESF+., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

The IPCC Interactive Atlas DataLab: Online reusability for regional climate change assessment

  • Cimadevilla, Ezequiel
  • Iturbide, Maialen
  • Cofiño, Antonio S.
  • Fernández, Jesús
  • Sitz, Lina E.
  • Palacio, Aida
  • Heredia Canales, Andrés
  • Gutiérrez, José M.
The Sixth Assessment Report (AR6) of the IPCC highlights the regionally varying impacts of climate change on both mean and extreme conditions, with significant socio-economic impacts. A key innovation of AR6 is the Interactive Atlas, which provides spatial and temporal analysis of over 20 Climatic Impact-Drivers (CIDs), integrating global and regional projection datasets from the CMIP and CORDEX model intercomparison projects. The Interactive Atlas allows users to explore, compare and download products relevant to regional climate change risk assessment, while adhering to FAIR principles to ensure data accessibility and reusability. This paper describes additional work undertaken to further support these principles, acknowledging the challenges of processing large-scale datasets. We present a cloud-enabled data laboratory—DataLab— developed using R and Python frameworks for advanced analysis and visualization. The DataLab seamlessly integrates the gridded dataset underpinning the Interactive Atlas with computational resources, combining traditional remote data access services and modern cloud-based solutions to balance cost-effectiveness with technological advances. This comprehensive resource supports regional climate change assessment and could be used to inform national adaptation plans and strengthen climate change research and policy development., Ph.D. grant PRE2021-097646 funded by MICIU/AEI/10.13039/501100011033 and by ESF+ (to E.C.). IMPETUS4CHANGE, grant agreement no. 101081555, from the European Union’s Horizon Europe research and innovation programme (to J.F.). IS-ENES3, grant agreement no. 824084, from the European Union’s Horizon 2020 research and innovation programme (to A.C.)., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

A science gateway for virtual analysis-ready climate data of the Earth System Grid Federation

  • Cimadevilla, Ezequiel
  • Palacio, Aida
The Earth System Grid Federation (ESGF) is a globally distributed data infrastructure that provides access to climate model outputs of critical importance, as they are used in climate change assessment reports of the Intergovernmental Panel on Climate Change (IPCC). Accessing data in the ESGF requires researchers to search for, download, and preprocess large datasets in a binary file format. Due to the huge number of binary files available in the federation, in the order of millions, climate analysis workflows of data stored in the ESGF result in significant inefficiencies. The ESGF Virtual Aggregation (ESGF-VA) extended the capabilities of the federation by introducing a novel approach to data analysis, based on remote data access and virtual analysis ready data. It eliminates the need for file searches and downloads without requiring data replication, aiming to provide more efficient climate data analysis. Logical and virtual aggregations provide seamless access to datasets in the ESGF while leveraging existing ESGF data services without modifications to the current architecture. In this work we introduce a science gateway for the ESGF-VA, in which we aim to offer a user-friendly platform for climate researchers, enabling remote data analysis over virtually aggregated climate datasets of the ESGF. We present the science gateway and detail its capabilities for supporting reproducibility of real climate change use cases derived from IPCC assessment reports., Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature., Ph.D. grant PRE2021-097646 funded by MICIU/AEI/10.13039/501100011033 and by ESF+., The article processing charges for this open-access publication were covered by the CSIC Open Access Publication Support Initiative through its Unit of Information Resources for Research (URICI)., Peer reviewed