Skip to main content

Resultados relacionados

Resultados totales (Incluyendo duplicados): 6
Encontrada(s) 1 página(s)

UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Enhancing HPC with serverless computing: Lithops on MareNostrum5

  • Benavides Arévalo, Andrés
  • Coll Tejeda, Daniel
  • Call Barreiro, Erin|||0000-0002-2770-1662
  • Garcia López, Pedro
  • Nou Castell, Ramon|||0000-0003-0464-1473
Serverless computing offers a novel alternative for developing and deploying applications. By abstracting backend architecture from the user, developers are encouraged to write code without worrying about server management, scaling, or maintenance. The Function-as-a-Service (FaaS) model optimizes this by allowing developers to deploy discrete functions that scale automatically in response to demand without deep concerns about the scalability of the execution infrastructure or platform. Lithops, a multi-cloud serverless computing framework, follows this trend and enables developers to execute Python code across thousands of cloud cores without modifying local scripts. Despite its potential to deploy parallel jobs, Lithops has been designed for running big data jobs over cloud environments, and its applicability to High-Performance Computing (HPC) systems has been unexplored. This paper introduces a novel architecture enabling Lithops deployment in HPC systems like the MareNostrum 5 supercomputer. By leveraging the immense computational power of the HPC-MN5 supercomputer and the FaaS model of Lithops, the architecture aims to offer high performance and scalability while simplifying application coding and deployment. Our evaluations display Lithops' benchmarks over the MareNostrum 5 HPC scale with the number of nodes, outperforming other commercial cloud platforms in terms of Floating Point Operations Per Second (FLOPS) and read-write bandwidth, and avoiding CPU wastage., This work has been partially financed by the European Commission (EU-HORIZON NEARDATA GA 101092644), Ministry of Science and Innovation under grant MCIN AEI/10.13039/ 501100011033/FEDER and PID GA PID2019- 107255GB-C21, and the Generalitat de Catalunya (AGAUR) under grant agreements 2021-SGR-00478 and 2021-SGR01626. The authors thankfully acknowledge RES resources provided by Barcelona Supercomputing Center in Data-Centric Computing Group to BCV-2024-2-0004., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Artículo científico (JournalArticle)

Dynamic selection and detection of spreading factors and channels for end-node devices of LoRa networks

  • Aliagas Castell, Carles|||0000-0003-2645-5444
  • Pueyo Centelles, Roger|||0000-0002-3133-0657
  • Meseguer Pallarès, Roc|||0000-0002-9414-646X
  • Millán Marco, Pere
  • Molina Clemente, Carlos Maria
LoRa and LoRaWAN facilitate effective long-range communication for IoT, with LoRa concentrating on transmission efficiency and low-power usage, while LoRaWAN addresses network architecture. Custom LoRa networks are ideal for small-scale applications due to their control and cost benefits. Nevertheless, large-scale deployments can experience message collisions, impacting efficiency and latency. LoRaWAN addresses this with Adaptive Data Rate (ADR), enhancing capacity and power efficiency. Our research introduced a novel strategy to improve LoRa network efficiency through a decentralized method. We employed multiple channels and spreading factors on client chips. This minimized contention and collisions. This approach allowed for dynamic adjustments, ensuring comprehensive communication control and enhanced performance in diverse environments. Our two-step mechanism, integrating heuristics and selection policies, provided flexible communication. We optimized parameters such as message size, transmission power, and bandwidth. This enhanced data rate, RSSI, and SNR, and reduced energy consumption. These results underscore the relevance of precise parameter tuning in achieving optimal LoRa performance., This work has been partially funded by the EU Horizon program under grant agreements No. 833057, No. 825184 and No. 101092644. It has also received support from the Ministry of Economic Affairs and Digital Transformation, together with the European Union-NextGenerationEU (within the PRTR and MRR frameworks), through the CLOUDLESS UNICO I+D CLOUD 2022. Addi- tional funding was provided by the Government of Spain under contracts PID2019-106774RB-C21, Electronics 2025, 14, 3341 34 of 36, PID2019-106774RB-C22, PID2020-113172RB-I00 and PID2024-155476OB-I00, and by the Government of Catalonia as Consolidated Research Groups 2021-SGR-383, 2021-SGR-109 and 2017-SGR-990., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Artículo científico (JournalArticle)

Exhaustive variant interaction analysis using multifactor dimensionality reduction

  • Gómez Sánchez, Gonzalo
  • Alonso Parrilla, Lorena
  • Pérez Elena, Miguel Ángel
  • Morán, Ignasi
  • Torrents Arenales, David
  • Berral García, Josep Lluís|||0000-0003-3037-3580
One of the main goals of human genetics is to understand the connections between genomic variation and the predisposition to develop a complex disorder. These disease–variant associations are usually studied in a single independent manner, disregarding the possible effect derived from the interaction between genomic variants. In particular, in a background of complex diseases, these interactions can be directly linked to the disorder and may play an important role in disease development. Although their study has been suggested to help complete the understanding of the genetic bases of complex diseases, this still represents a big challenge due to large computing demands. Here, we take advantage of high-performance computing technologies to tackle this problem by using a combination of machine learning methods and statistical approaches. As a result, we created a containerized framework that uses multifactor dimensionality reduction (MDR) to detect pairs of variants associated with type 2 diabetes (T2D). This methodology was tested on the Northwestern University NUgene project cohort using a dataset of 1,883,192 variant pairs with a certain degree of association with T2D. Out of the pairs studied, we identified 104 significant pairs: two of which exhibit a potential functional relationship with T2D. These results place the proposed MDR method as a valid, efficient, and portable solution to study variant interaction in real reduced genomic datasets., This work was partially financed by the European Commission (EU-HORIZON NEARDATA GA.101092644) and by the Universitat Politècnica de Catalunya (45-FPIUPC2018); it was also partially financed by Generalitat de Catalunya (AGAUR) under grant agreement 2021-SGR-00478; it was also partially financed by the Spanish Ministry of Science (MICINN), the Research State Agency (AEI), and European Regional Development Funds (ERDF/FEDER) under grant agreement PID2021-126248OB-I00, MCIN/AEI/10.13039/501100011033/FEDER, UE., Peer Reviewed
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Dynamic selection and detection of spreading factors and channels for end-node devices of LoRa networks

  • Aliagas Castell, Carles
  • Pueyo Centelles, Roger
  • Meseguer Pallarès, Roc
  • Millán Marco, Pere
  • Molina Clemente, Carlos Maria
LoRa and LoRaWAN facilitate effective long-range communication for IoT, with LoRa concentrating on transmission efficiency and low-power usage, while LoRaWAN addresses network architecture. Custom LoRa networks are ideal for small-scale applications due to their control and cost benefits. Nevertheless, large-scale deployments can experience message collisions, impacting efficiency and latency. LoRaWAN addresses this with Adaptive Data Rate (ADR), enhancing capacity and power efficiency. Our research introduced a novel strategy to improve LoRa network efficiency through a decentralized method. We employed multiple channels and spreading factors on client chips. This minimized contention and collisions. This approach allowed for dynamic adjustments, ensuring comprehensive communication control and enhanced performance in diverse environments. Our two-step mechanism, integrating heuristics and selection policies, provided flexible communication. We optimized parameters such as message size, transmission power, and bandwidth. This enhanced data rate, RSSI, and SNR, and reduced energy consumption. These results underscore the relevance of precise parameter tuning in achieving optimal LoRa performance., This work has been partially funded by the EU Horizon program under grant agreements No. 833057, No. 825184 and No. 101092644. It has also received support from the Ministry of Economic Affairs and Digital Transformation, together with the European Union-NextGenerationEU (within the PRTR and MRR frameworks), through the CLOUDLESS UNICO I+D CLOUD 2022. Addi- tional funding was provided by the Government of Spain under contracts PID2019-106774RB-C21, Electronics 2025, 14, 3341 34 of 36, PID2019-106774RB-C22, PID2020-113172RB-I00 and PID2024-155476OB-I00, and by the Government of Catalonia as Consolidated Research Groups 2021-SGR-383, 2021-SGR-109 and 2017-SGR-990., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Enhancing HPC with serverless computing: Lithops on MareNostrum5

  • Benavides Arévalo, Andrés
  • Coll Tejeda, Daniel
  • Call Barreiro, Erin
  • Garcia López, Pedro
  • Nou Castell, Ramon
Serverless computing offers a novel alternative for developing and deploying applications. By abstracting backend architecture from the user, developers are encouraged to write code without worrying about server management, scaling, or maintenance. The Function-as-a-Service (FaaS) model optimizes this by allowing developers to deploy discrete functions that scale automatically in response to demand without deep concerns about the scalability of the execution infrastructure or platform. Lithops, a multi-cloud serverless computing framework, follows this trend and enables developers to execute Python code across thousands of cloud cores without modifying local scripts. Despite its potential to deploy parallel jobs, Lithops has been designed for running big data jobs over cloud environments, and its applicability to High-Performance Computing (HPC) systems has been unexplored. This paper introduces a novel architecture enabling Lithops deployment in HPC systems like the MareNostrum 5 supercomputer. By leveraging the immense computational power of the HPC-MN5 supercomputer and the FaaS model of Lithops, the architecture aims to offer high performance and scalability while simplifying application coding and deployment. Our evaluations display Lithops' benchmarks over the MareNostrum 5 HPC scale with the number of nodes, outperforming other commercial cloud platforms in terms of Floating Point Operations Per Second (FLOPS) and read-write bandwidth, and avoiding CPU wastage., This work has been partially financed by the European Commission (EU-HORIZON NEARDATA GA 101092644), Ministry of Science and Innovation under grant MCIN AEI/10.13039/ 501100011033/FEDER and PID GA PID2019- 107255GB-C21, and the Generalitat de Catalunya (AGAUR) under grant agreements 2021-SGR-00478 and 2021-SGR01626. The authors thankfully acknowledge RES resources provided by Barcelona Supercomputing Center in Data-Centric Computing Group to BCV-2024-2-0004., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Exhaustive variant interaction analysis using multifactor dimensionality reduction

  • Gómez Sánchez, Gonzalo
  • Alonso Parrilla, Lorena
  • Pérez Elena, Miguel Ángel
  • Morán, Ignasi
  • Torrents Arenales, David
  • Berral García, Josep Lluís
One of the main goals of human genetics is to understand the connections between genomic variation and the predisposition to develop a complex disorder. These disease–variant associations are usually studied in a single independent manner, disregarding the possible effect derived from the interaction between genomic variants. In particular, in a background of complex diseases, these interactions can be directly linked to the disorder and may play an important role in disease development. Although their study has been suggested to help complete the understanding of the genetic bases of complex diseases, this still represents a big challenge due to large computing demands. Here, we take advantage of high-performance computing technologies to tackle this problem by using a combination of machine learning methods and statistical approaches. As a result, we created a containerized framework that uses multifactor dimensionality reduction (MDR) to detect pairs of variants associated with type 2 diabetes (T2D). This methodology was tested on the Northwestern University NUgene project cohort using a dataset of 1,883,192 variant pairs with a certain degree of association with T2D. Out of the pairs studied, we identified 104 significant pairs: two of which exhibit a potential functional relationship with T2D. These results place the proposed MDR method as a valid, efficient, and portable solution to study variant interaction in real reduced genomic datasets., This work was partially financed by the European Commission (EU-HORIZON NEARDATA GA.101092644) and by the Universitat Politècnica de Catalunya (45-FPIUPC2018); it was also partially financed by Generalitat de Catalunya (AGAUR) under grant agreement 2021-SGR-00478; it was also partially financed by the Spanish Ministry of Science (MICINN), the Research State Agency (AEI), and European Regional Development Funds (ERDF/FEDER) under grant agreement PID2021-126248OB-I00, MCIN/AEI/10.13039/501100011033/FEDER, UE., Peer Reviewed, Postprint (published version)