Pasar al contenido principal

Resultados relacionados

Resultados totales (Incluyendo duplicados): 16
Encontrada(s) 1 página(s)

UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

Towards generalizable Federated Learning in medical imaging: a real-world case study on mammography data

  • Tzortzis, Ioannis N.
  • Gutiérrez Torre, Alberto|||0000-0002-5548-3359
  • Sykiotis, Stavros
  • Agulló López, Ferran|||0000-0002-7276-2472
  • Bakalos, Nikolaos
  • Doulamis, Anastasios
  • Doulamis, Nikolaos
  • Berral García, Josep Lluís|||0000-0003-3037-3580
Federated Learning has been rapidly gaining in popularity in medical applications, due to the increased privacy offered, since medical data doesn't need to leave the hospitals' premises for AI model training. However, a direct translation of a classic experiment to a federated one is not always straightforward. In this work, we delve into the intricacies of federated learning for a breast cancer classification tool. We compare classic model training with a federated variant, and highlight the adaptations that need to be taken care of to ensure the equivalence between the two. Specifically, we introduce the Breast Area Detection tool as an essential component of the pre-processing pipeline to enhance the robustness of Federated Learning by offering data harmonization. On top of that, we present an end-to-end Federated Learning framework that is effective for real-world data and scenarios. Among the three real-world hospitals involved in the experimental procedure, the proposed framework significantly improves performance at the first hospital, providing consistent results similar to those achieved in the classic approach. Experimental results demonstrate that the interventions introduced improved model performance by approximately 35%, aligning federated learning and centralized model performance., This paper is funded by the EU funded projects SECURED “Scaling Up Secure Processing, Anonymization And Generation Of Health Data For EU Cross Border Collaborative Research And Innovation” with grant agreement no. 101095717 and INCISIVE “A multimodal AI-based toolbox and an interoperable health imaging repository for the empowerment of imaging analysis related to the diagnosis, prediction and follow-up of cancer” with grant agreement no. 952179. This paper has been partially financed by the Spanish Ministry of Science (MICINN), the Research State Agency (AEI) and European Regional Development Funds (ERDF/FEDER) under grant agreement PID2021-126248OB-I00, Severo Ochoa Center of Excellence CEX-2021-001148-S-20-3, 2021- SGR-00478, UE, also Generalitat de Catalunya (AGAUR) under grant agreement 2021-SGR-00478., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

Inverse geo-electromagnetic modeling: a systematic review and bibliometric assessment

  • Castillo Reyes, Octavio|||0000-0003-4271-5015
  • Jiménez Andrade, José Luis
  • Dehiya, Rahul
  • Iturraràn Viveros, Ursula
Inverse electromagnetic (EM) modeling plays a pivotal role in subsurface exploration, enabling the characterization of the Earth’s electrical properties for various applications, including resource exploration, environmental monitoring, and geohazard assessment. Despite significant advancements in the field, the EM inverse problem remains inherently challenging due to its ill-posed and nonlinear nature. A diverse range of methodologies, including deterministic, non-deterministic, and machine learning-based (ML-based) approaches, have been proposed to address these challenges. However, there is a lack of a comprehensive synthesis that integrates both the theoretical evolution of these methods and their bibliometric performance. This paper addresses this gap by combining a systematic review of modern computational methodologies with a bibliometric assessment of the scientific literature on inverse EM modeling. The systematic review critically evaluates key computational approaches, examining their theoretical foundations, practical applications, and limitations, while the bibliometric assessment provides a quantitative assessment of scientific productivity, trends, and contributions from different nations. This integrated perspective offers a unified overview of the field, identifies emerging research directions, and highlights the state-of-the-art in inverse EM modeling. The findings provide valuable insights for researchers, practitioners, and policymakers, guiding future advancements and fostering interdisciplinary collaboration., The work of OC have received funding from the MCIN/AEI/10.13039/501100011033 (Spain) and from the European Union NextGenerationEU/PRTR under the project GEOTHERPAL-EM_TED2021-131882B-C42 and -C41. OC has also been partially financed by Generalitat de Catalunya (AGAUR) under grant agreement 2021-SGR-00478. JJA has received support form DGAPA-UNAM IN310325. UI-V was partially supported by JST SATREPS Japan Grant Number JPMJSA2310; DGAPA-UNAM project numbers: IN111823, IN107720 and CONAHCYT México under Ciencia de Frontera Project Number: 6655. Finally, this work has been partially financed by the Spanish Ministry of Science (MICINN), the Research State Agency (AEI) and European Regional Development Funds (ERDF/FEDER) under grant agreement PID2021-126248OB-I00, MCIN/AEI/10.13039/ 501100011033/FEDER, UE. Authors thanks to Josep Ll. Berral (UPC) and the CROMAI team (UPC) for their support on this research., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

Embedded scaffolding for teaching and assessing inquiry-based hands-on laboratory on distributed systems

  • Guitart Fernández, Jordi|||0000-0003-0751-3100
Context Information Technology education must cultivate proficiency on distributed systems, including strong hands-on laboratory skills, to meet the needs of the society and the industry. Given the complexity of distributed systems, any successful methodology to teach them to novice students must be scaffolded appropriately to ensure that the students acquire the required degree of expertise. Objective We propose a comprehensive scaffolding approach for inquiry-based hands-on laboratory on a distributed systems course, which guides not only the learning process, but also its assessment. The approach is based mainly on embedded scaffolds, namely explicit coding and experimental milestones and open questions with predefined grades, but also features contingent scaffolds provided by the teacher when additional assistance is needed. Method We apply the methodology in the context of the subject ‘Distributed Network Systems’ offered by our university. We compare the students' performance during three academic courses using the proposed methodology with respect to the three previous courses that were still using the former methodology. We use both visual representations and planned Analysis of Variance (ANOVA) tests to verify our hypothesis defined as a complex contrast. Findings We find that there is a statistically significant improvement in the students' performance when using the new methodology, both in their grades of the assignments (F(1, 75.364) = 17.770, p = 6.85*10^-5) and, more importantly, also in their grades of the exam questions about the practicals (F(1, 123.186) = 13.285, p = 3.93*10^-4). Implications Our results encourage other instructors to incorporate embedded scaffolds for teaching and assessing their hands-on laboratories on distributed systems., This research was partially supported by the Agencia Estatal de Investigación under contracts PID2019-107255GB-C22 and PID2021-126248OB-I00 and by the Generalitat de Catalunya under contract 2021-SGR-00478., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

Scalable energy-aware VM allocation on cloud data centers through mathematical programming models

  • Meroni, Roberto
  • Guitart Fernández, Jordi|||0000-0003-0751-3100
Cloud data centers are becoming indispensable pillars of modern society, driving AI innovation, global connectivity, and data-driven advancements. As their size and complexity grow, so does the urgency for sustainable and efficient solutions to address operational and environmental challenges. The Virtual Machine (VM) allocation problem lies at the heart of these challenges, directly impacting energy consumption, scalability, and cost-effectiveness. While heuristics are traditionally favored for their fast execution times, they fail to adequately address the complexities of heterogeneous environments and the increasing need for energy-aware solutions. In this work, we redefine the potential of mathematical programming models — traditionally considered impractical due to scalability limitations — by defining a comprehensive VM allocation strategy that embeds the models into scalable algorithms that distribute computational workloads and exploit solver capabilities. This approach achieves linear scalability — an unprecedented milestone for mathematical programming — allowing us to integrate detailed and heterogeneous aspects of the VM allocation problem. The resulting algorithms dramatically outperform state-of-the-art heuristics and metaheuristics in both scalability and solution quality, delivering an average 16% increase in Net Profit, a 54% reduction in Total Energy Consumption, and a more-than-double improvement in Energy Efficiency. Designed to meet the evolving demands of modern Cloud data centers, our algorithms scale efficiently to manage growing workloads, adapt to heterogeneity, and comply with sustainability and regulatory requirements by prioritizing energy efficiency, facilitating the transition to next-generation Cloud environments., This research was partially supported by the EU-HORIZON programme under grant agreement EU-HORIZON GA.101092646, by the Spanish Ministry of Science and the Research State Agency (MICIU/AEI/ 10.13039/501100011033) and by European Regional Development Funds (ERDF/FEDER) under contract PID2021-126248OB-I00, and by the Generalitat de Catalunya (AGAUR) under contract 2021-SGR-00478., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

FRIDA: Free-rider detection using privacy attacks

  • Garcia Recasens, Pol|||0009-0008-5535-0012
  • Horváth, Ádám
  • Gutiérrez Torre, Alberto|||0000-0002-5548-3359
  • Torres Viñals, Jordi|||0000-0003-1963-7418
  • Berral García, Josep Lluís|||0000-0003-3037-3580
  • Pejó, Balázs|||0000-0002-1825-9251
Federated learning is increasingly popular as it enables multiple parties with limited datasets and resources to train a machine learning model collaboratively. However, similar to other collaborative systems, federated learning is vulnerable to free-riders — participants who benefit from the global model without contributing. Free-riders compromise the integrity of the learning process and slow down the convergence of the global model, resulting in increased costs for honest participants. To address this challenge, we propose FRIDA: free-rider detection using privacy attacks. Instead of focusing on implicit effects of free-riding, FRIDA utilizes membership and property inference attacks to directly infer evidence of genuine client training. Our extensive evaluation demonstrates that FRIDA is effective across a wide range of scenarios., Project no. 145832, implemented with the support provided by the Ministry of Innovation and Technology from the NRDI Fund, financed under the PD_23 funding scheme. Also, partially financed by the Spanish Ministry of Science (MICINN), the Research State Agency (AEI), and European Regional Development Funds (ERDF/FEDER) under grant agreement PID2021-126248OB-I00, MCIN/AEI/10.13039/501100011033/FEDER, UE, and Generalitat de Catalunya (AGAUR) under grant 2021-SGR-00478. Lastly, also funded by the European Union (Grant Agreement Nr. 101095717, SECURED Project)., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

Enhancing the output of time series forecasting algorithms for cloud resource provisioning

  • Agulló López, Ferran|||0000-0002-7276-2472
  • Gutiérrez Torre, Alberto|||0000-0002-5548-3359
  • Torres Viñals, Jordi|||0000-0003-1963-7418
  • Berral García, Josep Lluís|||0000-0003-3037-3580
Forecasting the resource consumption of workloads is a frequent approach in the cloud provisioning field. Ideally, such predictions allow obtaining a more accurate scheduling and management of resources in a computing cluster. However, the current approaches fail to properly forecast the future consumption in areas where sudden increases of consumption are present, i.e., spikes. Even, commonly employed metrics lack the ability to properly evaluate sharp behaviours in the traces. This may generate resource starvation problems in the running workloads and decreases the Quality of Service (QoS) provided to external users. To address this issue, we propose two strategies that modify the outputs of forecasting algorithms without changing the algorithms’ internals. The new outputs considerably enhance the prediction of sudden increases, duplicating the F1 score metric in average for all tested algorithms. This improvement in the handling of spikes comes with an increased over-provision of resources. Nevertheless, the proposed strategies give the user an easy way to control this trade-off between predicting spikes and the amount of over-provision. The user can decide which is the right balance that better fits the requirements of its specific scenario. Furthermore, we propose a new evaluation methodology that better assesses the behaviour of forecasting algorithms in cloud traces, especially focused on the performance around increases of consumption, and we give insights on the reasons behind the predictions of the algorithms with the application of explainability techniques. The code repository of this work can be accessed through GitHub at this link https://github.com/FerranAgulloLopez/ResourceForecasting., This work has been supported by the EU’s Horizon research and innovation programme under grant agreements HORIZON GA.101092646 (CloudSkin), HORIZON MSCA GA.101086248 (CloudStars), and by the Spanish Ministry of Science (MICINN), the Research State Agency (AEI) and European Regional Development Funds (ERDF/FEDER) under grant agreements PID-2021-126248OB-I00, MCIN/AEI/10.13039/ 501100011033, UE (DALEST), Severo Ochoa Center of Excellence CEX-2021-001148-S-20-3 and the Generalitat de Catalunya (AGAUR), Spain 2021-SGR-00478 (CROMAI)., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

SynthVal: A framework for validating synthetic medical images

  • Guidotti, Dario
  • Pandolfo, Laura
  • Gutiérrez Torre, Alberto|||0000-0002-5548-3359
  • López Rúbio, Omar
  • Pulina, Luca
Synthetic data is increasingly used in medical imaging to overcome data scarcity and privacy constraints. However, assessing the fidelity of synthetic images remains a critical challenge for ensuring their safe and effective use in clinical and AI applications. We present SynthVal, a Python-based framework for validating the quality of synthetic medical images through statistical comparisons in deep feature space. SynthVal extracts semantic image embeddings using transformer-based models and computes similarity metrics – including Fréchet Distance, Wasserstein Distance, and Kullback-Leibler Divergence – between real and synthetic data distributions. The framework is designed for modularity, scalability, and ease of integration into existing workflows via pip installation. We evaluate SynthVal using real images from the CSAW-CC dataset, and synthetic images produced by a model developed by the Barcelona Supercomputing Center. Our experiments systematically benchmark the influence of different feature extraction models and similarity metrics, providing practical insights for selecting validation strategies in medical image synthesis. SynthVal offers a reproducible and extensible solution for quality control in synthetic data pipelines., The work of Dario Guidotti, Laura Pandolfo, and Luca Pulina was supported by EU Project SECURED, ‘‘Scaling Up Secure Processing, Anonymization and Generation of Health Data for EU Cross-Border Collaborative Research and Innovation,’’ under Agreement 101095717. The work of Alberto Gutierrez-Torre and Omar Lopez-Rubio was supported by SECURED under Agreement 101095717; in part by Spanish Ministry of Science (MICINN), the State Research Agency (AEI), and European Regional Development Funds (ERDF/FEDER) under Grant PID2021-126248OB-I00; in part by MCIN/AEI/10.13039/501100011033/FEDER, UE; and in part by the Generalitat de Catalunya (AGAUR) under Grant 2021-SGR-00478., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

Exhaustive variant interaction analysis using multifactor dimensionality reduction

  • Gómez Sánchez, Gonzalo
  • Alonso Parrilla, Lorena
  • Pérez Elena, Miguel Ángel
  • Morán, Ignasi
  • Torrents Arenales, David
  • Berral García, Josep Lluís|||0000-0003-3037-3580
One of the main goals of human genetics is to understand the connections between genomic variation and the predisposition to develop a complex disorder. These disease–variant associations are usually studied in a single independent manner, disregarding the possible effect derived from the interaction between genomic variants. In particular, in a background of complex diseases, these interactions can be directly linked to the disorder and may play an important role in disease development. Although their study has been suggested to help complete the understanding of the genetic bases of complex diseases, this still represents a big challenge due to large computing demands. Here, we take advantage of high-performance computing technologies to tackle this problem by using a combination of machine learning methods and statistical approaches. As a result, we created a containerized framework that uses multifactor dimensionality reduction (MDR) to detect pairs of variants associated with type 2 diabetes (T2D). This methodology was tested on the Northwestern University NUgene project cohort using a dataset of 1,883,192 variant pairs with a certain degree of association with T2D. Out of the pairs studied, we identified 104 significant pairs: two of which exhibit a potential functional relationship with T2D. These results place the proposed MDR method as a valid, efficient, and portable solution to study variant interaction in real reduced genomic datasets., This work was partially financed by the European Commission (EU-HORIZON NEARDATA GA.101092644) and by the Universitat Politècnica de Catalunya (45-FPIUPC2018); it was also partially financed by Generalitat de Catalunya (AGAUR) under grant agreement 2021-SGR-00478; it was also partially financed by the Spanish Ministry of Science (MICINN), the Research State Agency (AEI), and European Regional Development Funds (ERDF/FEDER) under grant agreement PID2021-126248OB-I00, MCIN/AEI/10.13039/501100011033/FEDER, UE., Peer Reviewed
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Inverse geo-electromagnetic modeling: a systematic review and bibliometric assessment

  • Castillo Reyes, Octavio
  • Jiménez Andrade, José Luis
  • Dehiya, Rahul
  • Iturraràn Viveros, Ursula
Inverse electromagnetic (EM) modeling plays a pivotal role in subsurface exploration, enabling the characterization of the Earth’s electrical properties for various applications, including resource exploration, environmental monitoring, and geohazard assessment. Despite significant advancements in the field, the EM inverse problem remains inherently challenging due to its ill-posed and nonlinear nature. A diverse range of methodologies, including deterministic, non-deterministic, and machine learning-based (ML-based) approaches, have been proposed to address these challenges. However, there is a lack of a comprehensive synthesis that integrates both the theoretical evolution of these methods and their bibliometric performance. This paper addresses this gap by combining a systematic review of modern computational methodologies with a bibliometric assessment of the scientific literature on inverse EM modeling. The systematic review critically evaluates key computational approaches, examining their theoretical foundations, practical applications, and limitations, while the bibliometric assessment provides a quantitative assessment of scientific productivity, trends, and contributions from different nations. This integrated perspective offers a unified overview of the field, identifies emerging research directions, and highlights the state-of-the-art in inverse EM modeling. The findings provide valuable insights for researchers, practitioners, and policymakers, guiding future advancements and fostering interdisciplinary collaboration., The work of OC have received funding from the MCIN/AEI/10.13039/501100011033 (Spain) and from the European Union NextGenerationEU/PRTR under the project GEOTHERPAL-EM_TED2021-131882B-C42 and -C41. OC has also been partially financed by Generalitat de Catalunya (AGAUR) under grant agreement 2021-SGR-00478. JJA has received support form DGAPA-UNAM IN310325. UI-V was partially supported by JST SATREPS Japan Grant Number JPMJSA2310; DGAPA-UNAM project numbers: IN111823, IN107720 and CONAHCYT México under Ciencia de Frontera Project Number: 6655. Finally, this work has been partially financed by the Spanish Ministry of Science (MICINN), the Research State Agency (AEI) and European Regional Development Funds (ERDF/FEDER) under grant agreement PID2021-126248OB-I00, MCIN/AEI/10.13039/ 501100011033/FEDER, UE. Authors thanks to Josep Ll. Berral (UPC) and the CROMAI team (UPC) for their support on this research., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Scalable energy-aware VM allocation on cloud data centers through mathematical programming models

  • Meroni, Roberto
  • Guitart Fernández, Jordi
Cloud data centers are becoming indispensable pillars of modern society, driving AI innovation, global connectivity, and data-driven advancements. As their size and complexity grow, so does the urgency for sustainable and efficient solutions to address operational and environmental challenges. The Virtual Machine (VM) allocation problem lies at the heart of these challenges, directly impacting energy consumption, scalability, and cost-effectiveness. While heuristics are traditionally favored for their fast execution times, they fail to adequately address the complexities of heterogeneous environments and the increasing need for energy-aware solutions. In this work, we redefine the potential of mathematical programming models — traditionally considered impractical due to scalability limitations — by defining a comprehensive VM allocation strategy that embeds the models into scalable algorithms that distribute computational workloads and exploit solver capabilities. This approach achieves linear scalability — an unprecedented milestone for mathematical programming — allowing us to integrate detailed and heterogeneous aspects of the VM allocation problem. The resulting algorithms dramatically outperform state-of-the-art heuristics and metaheuristics in both scalability and solution quality, delivering an average 16% increase in Net Profit, a 54% reduction in Total Energy Consumption, and a more-than-double improvement in Energy Efficiency. Designed to meet the evolving demands of modern Cloud data centers, our algorithms scale efficiently to manage growing workloads, adapt to heterogeneity, and comply with sustainability and regulatory requirements by prioritizing energy efficiency, facilitating the transition to next-generation Cloud environments., This research was partially supported by the EU-HORIZON programme under grant agreement EU-HORIZON GA.101092646, by the Spanish Ministry of Science and the Research State Agency (MICIU/AEI/ 10.13039/501100011033) and by European Regional Development Funds (ERDF/FEDER) under contract PID2021-126248OB-I00, and by the Generalitat de Catalunya (AGAUR) under contract 2021-SGR-00478., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

FRIDA: Free-rider detection using privacy attacks

  • Garcia Recasens, Pol
  • Horváth, Ádám
  • Gutiérrez Torre, Alberto
  • Torres Viñals, Jordi
  • Berral García, Josep Lluís
  • Pejó, Balázs
Federated learning is increasingly popular as it enables multiple parties with limited datasets and resources to train a machine learning model collaboratively. However, similar to other collaborative systems, federated learning is vulnerable to free-riders — participants who benefit from the global model without contributing. Free-riders compromise the integrity of the learning process and slow down the convergence of the global model, resulting in increased costs for honest participants. To address this challenge, we propose FRIDA: free-rider detection using privacy attacks. Instead of focusing on implicit effects of free-riding, FRIDA utilizes membership and property inference attacks to directly infer evidence of genuine client training. Our extensive evaluation demonstrates that FRIDA is effective across a wide range of scenarios., Project no. 145832, implemented with the support provided by the Ministry of Innovation and Technology from the NRDI Fund, financed under the PD_23 funding scheme. Also, partially financed by the Spanish Ministry of Science (MICINN), the Research State Agency (AEI), and European Regional Development Funds (ERDF/FEDER) under grant agreement PID2021-126248OB-I00, MCIN/AEI/10.13039/501100011033/FEDER, UE, and Generalitat de Catalunya (AGAUR) under grant 2021-SGR-00478. Lastly, also funded by the European Union (Grant Agreement Nr. 101095717, SECURED Project)., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

SynthVal: A framework for validating synthetic medical images

  • Guidotti, Dario
  • Pandolfo, Laura
  • Gutiérrez Torre, Alberto
  • López Rúbio, Omar
  • Pulina, Luca
Synthetic data is increasingly used in medical imaging to overcome data scarcity and privacy constraints. However, assessing the fidelity of synthetic images remains a critical challenge for ensuring their safe and effective use in clinical and AI applications. We present SynthVal, a Python-based framework for validating the quality of synthetic medical images through statistical comparisons in deep feature space. SynthVal extracts semantic image embeddings using transformer-based models and computes similarity metrics – including Fréchet Distance, Wasserstein Distance, and Kullback-Leibler Divergence – between real and synthetic data distributions. The framework is designed for modularity, scalability, and ease of integration into existing workflows via pip installation. We evaluate SynthVal using real images from the CSAW-CC dataset, and synthetic images produced by a model developed by the Barcelona Supercomputing Center. Our experiments systematically benchmark the influence of different feature extraction models and similarity metrics, providing practical insights for selecting validation strategies in medical image synthesis. SynthVal offers a reproducible and extensible solution for quality control in synthetic data pipelines., The work of Dario Guidotti, Laura Pandolfo, and Luca Pulina was supported by EU Project SECURED, ‘‘Scaling Up Secure Processing, Anonymization and Generation of Health Data for EU Cross-Border Collaborative Research and Innovation,’’ under Agreement 101095717. The work of Alberto Gutierrez-Torre and Omar Lopez-Rubio was supported by SECURED under Agreement 101095717; in part by Spanish Ministry of Science (MICINN), the State Research Agency (AEI), and European Regional Development Funds (ERDF/FEDER) under Grant PID2021-126248OB-I00; in part by MCIN/AEI/10.13039/501100011033/FEDER, UE; and in part by the Generalitat de Catalunya (AGAUR) under Grant 2021-SGR-00478., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Embedded scaffolding for teaching and assessing inquiry-based hands-on laboratory on distributed systems

  • Guitart Fernández, Jordi
Context Information Technology education must cultivate proficiency on distributed systems, including strong hands-on laboratory skills, to meet the needs of the society and the industry. Given the complexity of distributed systems, any successful methodology to teach them to novice students must be scaffolded appropriately to ensure that the students acquire the required degree of expertise. Objective We propose a comprehensive scaffolding approach for inquiry-based hands-on laboratory on a distributed systems course, which guides not only the learning process, but also its assessment. The approach is based mainly on embedded scaffolds, namely explicit coding and experimental milestones and open questions with predefined grades, but also features contingent scaffolds provided by the teacher when additional assistance is needed. Method We apply the methodology in the context of the subject ‘Distributed Network Systems’ offered by our university. We compare the students' performance during three academic courses using the proposed methodology with respect to the three previous courses that were still using the former methodology. We use both visual representations and planned Analysis of Variance (ANOVA) tests to verify our hypothesis defined as a complex contrast. Findings We find that there is a statistically significant improvement in the students' performance when using the new methodology, both in their grades of the assignments (F(1, 75.364) = 17.770, p = 6.85*10^-5) and, more importantly, also in their grades of the exam questions about the practicals (F(1, 123.186) = 13.285, p = 3.93*10^-4). Implications Our results encourage other instructors to incorporate embedded scaffolds for teaching and assessing their hands-on laboratories on distributed systems., This research was partially supported by the Agencia Estatal de Investigación under contracts PID2019-107255GB-C22 and PID2021-126248OB-I00 and by the Generalitat de Catalunya under contract 2021-SGR-00478., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Enhancing the output of time series forecasting algorithms for cloud resource provisioning

  • Agulló López, Ferran
  • Gutiérrez Torre, Alberto
  • Torres Viñals, Jordi
  • Berral García, Josep Lluís
Forecasting the resource consumption of workloads is a frequent approach in the cloud provisioning field. Ideally, such predictions allow obtaining a more accurate scheduling and management of resources in a computing cluster. However, the current approaches fail to properly forecast the future consumption in areas where sudden increases of consumption are present, i.e., spikes. Even, commonly employed metrics lack the ability to properly evaluate sharp behaviours in the traces. This may generate resource starvation problems in the running workloads and decreases the Quality of Service (QoS) provided to external users. To address this issue, we propose two strategies that modify the outputs of forecasting algorithms without changing the algorithms’ internals. The new outputs considerably enhance the prediction of sudden increases, duplicating the F1 score metric in average for all tested algorithms. This improvement in the handling of spikes comes with an increased over-provision of resources. Nevertheless, the proposed strategies give the user an easy way to control this trade-off between predicting spikes and the amount of over-provision. The user can decide which is the right balance that better fits the requirements of its specific scenario. Furthermore, we propose a new evaluation methodology that better assesses the behaviour of forecasting algorithms in cloud traces, especially focused on the performance around increases of consumption, and we give insights on the reasons behind the predictions of the algorithms with the application of explainability techniques. The code repository of this work can be accessed through GitHub at this link https://github.com/FerranAgulloLopez/ResourceForecasting., This work has been supported by the EU’s Horizon research and innovation programme under grant agreements HORIZON GA.101092646 (CloudSkin), HORIZON MSCA GA.101086248 (CloudStars), and by the Spanish Ministry of Science (MICINN), the Research State Agency (AEI) and European Regional Development Funds (ERDF/FEDER) under grant agreements PID-2021-126248OB-I00, MCIN/AEI/10.13039/ 501100011033, UE (DALEST), Severo Ochoa Center of Excellence CEX-2021-001148-S-20-3 and the Generalitat de Catalunya (AGAUR), Spain 2021-SGR-00478 (CROMAI)., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Towards generalizable Federated Learning in medical imaging: a real-world case study on mammography data

  • Tzortzis, Ioannis N.
  • Gutiérrez Torre, Alberto
  • Sykiotis, Stavros
  • Agulló López, Ferran
  • Bakalos, Nikolaos
  • Doulamis, Anastasios
  • Doulamis, Nikolaos
  • Berral García, Josep Lluís
Federated Learning has been rapidly gaining in popularity in medical applications, due to the increased privacy offered, since medical data doesn't need to leave the hospitals' premises for AI model training. However, a direct translation of a classic experiment to a federated one is not always straightforward. In this work, we delve into the intricacies of federated learning for a breast cancer classification tool. We compare classic model training with a federated variant, and highlight the adaptations that need to be taken care of to ensure the equivalence between the two. Specifically, we introduce the Breast Area Detection tool as an essential component of the pre-processing pipeline to enhance the robustness of Federated Learning by offering data harmonization. On top of that, we present an end-to-end Federated Learning framework that is effective for real-world data and scenarios. Among the three real-world hospitals involved in the experimental procedure, the proposed framework significantly improves performance at the first hospital, providing consistent results similar to those achieved in the classic approach. Experimental results demonstrate that the interventions introduced improved model performance by approximately 35%, aligning federated learning and centralized model performance., This paper is funded by the EU funded projects SECURED “Scaling Up Secure Processing, Anonymization And Generation Of Health Data For EU Cross Border Collaborative Research And Innovation” with grant agreement no. 101095717 and INCISIVE “A multimodal AI-based toolbox and an interoperable health imaging repository for the empowerment of imaging analysis related to the diagnosis, prediction and follow-up of cancer” with grant agreement no. 952179. This paper has been partially financed by the Spanish Ministry of Science (MICINN), the Research State Agency (AEI) and European Regional Development Funds (ERDF/FEDER) under grant agreement PID2021-126248OB-I00, Severo Ochoa Center of Excellence CEX-2021-001148-S-20-3, 2021- SGR-00478, UE, also Generalitat de Catalunya (AGAUR) under grant agreement 2021-SGR-00478., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Exhaustive variant interaction analysis using multifactor dimensionality reduction

  • Gómez Sánchez, Gonzalo
  • Alonso Parrilla, Lorena
  • Pérez Elena, Miguel Ángel
  • Morán, Ignasi
  • Torrents Arenales, David
  • Berral García, Josep Lluís
One of the main goals of human genetics is to understand the connections between genomic variation and the predisposition to develop a complex disorder. These disease–variant associations are usually studied in a single independent manner, disregarding the possible effect derived from the interaction between genomic variants. In particular, in a background of complex diseases, these interactions can be directly linked to the disorder and may play an important role in disease development. Although their study has been suggested to help complete the understanding of the genetic bases of complex diseases, this still represents a big challenge due to large computing demands. Here, we take advantage of high-performance computing technologies to tackle this problem by using a combination of machine learning methods and statistical approaches. As a result, we created a containerized framework that uses multifactor dimensionality reduction (MDR) to detect pairs of variants associated with type 2 diabetes (T2D). This methodology was tested on the Northwestern University NUgene project cohort using a dataset of 1,883,192 variant pairs with a certain degree of association with T2D. Out of the pairs studied, we identified 104 significant pairs: two of which exhibit a potential functional relationship with T2D. These results place the proposed MDR method as a valid, efficient, and portable solution to study variant interaction in real reduced genomic datasets., This work was partially financed by the European Commission (EU-HORIZON NEARDATA GA.101092644) and by the Universitat Politècnica de Catalunya (45-FPIUPC2018); it was also partially financed by Generalitat de Catalunya (AGAUR) under grant agreement 2021-SGR-00478; it was also partially financed by the Spanish Ministry of Science (MICINN), the Research State Agency (AEI), and European Regional Development Funds (ERDF/FEDER) under grant agreement PID2021-126248OB-I00, MCIN/AEI/10.13039/501100011033/FEDER, UE., Peer Reviewed, Postprint (published version)