Skip to main content

Resultados relacionados

Resultados totales (Incluyendo duplicados): 9
Encontrada(s) 1 página(s)

RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publication Artículo científico (JournalArticle)

Federated and secure cloud services for building medical image classifiers on an intercontinental infrastructure

  • Blanquer Espert, Ignacio|||0000-0003-1692-8922
  • Calatrava Arroyo, Amanda|||0000-0002-9018-9171
  • Brasileiro, F.
  • Brito, A.
  • Carvalho, André
  • Fetzer, C.
  • Figueiredo, F.
  • Guimarães, R. P.
  • Marinho, L.
  • Wagner Meira Jr.
  • Silva, Altigran
  • Alberich-Bayarri, Ángel
  • E. Camacho-Ramos
  • Jimenez-Pastor, Ana Maria
  • Ribeiro, Antonio L. P.
  • B. R. Nascimento
  • F. Silva
[EN] Medical data processing has found a new dimension with the extensive use of machine-learning techniques to classify and extract features. Machine learning strongly benefits from computing accelerators. However, such accelerators are not easily available at hospital premises, although they can be easily found on public cloud infrastructures or research centers. Nevertheless, the sensitivity of medical data poses several challenges on the access to such data, requiring security guarantees and isolation. In this paper we present an architecture that addresses this problem. It keeps critical data encrypted in memory and disk, which can only be accessed inside trusted execution environments protected by hardware extensions. Data is anonymized inside these environments and securely transferred to external sites that host accelerator devices, keeping the same network space and reducing security risks even in untrusted cloud backends. Results on the processing of data in different scenarios are presented and discussed. The results are demonstrated on a geographically-wide deployment provided by the ATMOSPHERE project., The work in this paper is mainly developed in the context of the project ATMOSPHERE, funded jointly by the European Commission under the Cooperation Programme, Horizon 2020 grant agreement No 777154 and the Brazilian Ministério de Ciência, Tecnologia e Inovação (MCTI), number 51119. UFCG researchers were partially supported by FAPESP, Brazil, grant 2015/24461-2. Dr. Ribeiro was supported in part by CNPq, Brazil (Bolsa de produtividade em pesquisa, 310679/2016-8, and Instituto de Avaliação de Tecnologias em Saúde IATS, Brazil, 465518/2014-1) and by FAPEMIG, Brazil (Programa Pesquisa do Mineiro, PPM-00428-17).
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publication Artículo científico (JournalArticle)

Multi-elastic Datacenters: Auto-scaled Virtual Clusters on Energy-Aware Physical Infrastructures

  • Alfonso Laguna, Carlos De|||0000-0002-2378-021X
  • Caballer Fernández, Miguel|||0000-0001-9393-3077
  • Calatrava Arroyo, Amanda|||0000-0002-9018-9171
  • Moltó, Germán|||0000-0002-8049-253X
  • Blanquer Espert, Ignacio|||0000-0003-1692-8922
[EN] Computer clusters are widely used platforms to execute different computational workloads. Indeed, the advent of virtualization and Cloud computing has paved the way to deploy virtual elastic clusters on top of Cloud infrastructures, which are typically backed by physical computing clusters. In turn, the advances in Green computing have fostered the ability to dynamically power on the nodes of physical clusters as required. Therefore, this paper introduces an open-source framework to deploy elastic virtual clusters running on elastic physical clusters where the computing capabilities of the virtual clusters are dynamically changed to satisfy both the user application's computing requirements and to minimise the amount of energy consumed by the underlying physical cluster that supports an on-premises Cloud. For that, we integrate: i) an elasticity manager both at the infrastructure level (power management) and at the virtual infrastructure level (horizontal elasticity); ii) an automatic Virtual Machine (VM) consolidation agent that reduces the amount of powered on physical nodes using live migration and iii) a vertical elasticity manager to dynamically and transparently change the memory allocated to VMs, thus fostering enhanced consolidation. A case study based on real datasets executed on a production infrastructure is used to validate the proposed solution. The results show that a multi-elastic virtualized datacenter provides users with the ability to deploy customized scalable computing clusters while reducing its energy footprint., The results of this work have been partially supported by ATMOSPHERE (Adaptive, Trustworthy, Manageable, Orchestrated, Secure, Privacy-assuring Hybrid, Ecosystem for Resilient Cloud Computing), funded by the European Commission under the Cooperation Programme, Horizon 2020 grant agreement No 777154.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publication Contribución de congreso (ConferenceOutput)

A Cloud Architecture for the Execution of Medical Imaging Biomarkers

  • López-Huguet, Sergio
  • García-Castro, Fabio
  • Alberich-Bayarri, Angel
  • Blanquer Espert, Ignacio|||0000-0003-1692-8922
Digital Medical Imaging is increasingly being used in clinical routine and research. As a consequence, the workload in medical imaging departments in hospitals has multiplied by over 20 in the last decade. Medical Image processing requires intensive computing resources not available at hospitals, but which could be provided by public clouds. The article analyses the requirements of processing digital medical images and introduces a cloud-based architecture centred on a DevOps approach to deploying resources on demand, adjusting them based on the request of resources and the expected execution time to deal with an unplanned workload. Results presented show a low overhead and high flexibility executing a lung disease biomarker on a public cloud., The work in this article has been co-funded by project SME Instrument Phase II - 778064, QUIBIM Precision, funded by the European Commission under the INDUSTRIAL LEADERSHIP - Leadership in enabling and industrial technologies - Information and Communication Technologies (ICT), Horizon 2020, project ATMOSPHERE, funded jointly by the European Commission under the Cooperation Programme, Horizon 2020 grant agreement No 777154 and the Brazilian Ministerio de Ciencia, Tecnologia e Inovacao (MCTI), number 51119. The authors would like also to thank the Spanish Ministerio de Economia, Industria y Competitividad¿ for the project BigCLOE with reference number TIN2016-79951-R.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publication Contribución de congreso (ConferenceOutput)

Medical Imaging Processing Architecture on ATMOSPHERE Federated Platform

  • Blanquer Espert, Ignacio|||0000-0003-1692-8922
  • Alberich-Bayarri, Ángel
  • García-Castro, Fabio
  • Teodoro, George
  • Meirelles, André
  • Nascimento, Bruno
  • Meira Jr., Wagner
  • Ribeiro, Antonio L. P.
[EN] This paper describes the development of applications in the frame of the ATMOSPHERE platform. ATMOSPHERE provides means for developing container-based applications over a federated cloud offering measurin he trustworthiness of the applications. In this paper we show the design of a transcontinental application in the frame of medical imaging that keeps the data at one end and uses the processing capabilities of the resources available at the other end. The applications are described using TOSCA blueprints and the federation of IaaS resources is performed by the Fogbow middleware. Privacy guarantees are provided by means of SCONE and intensive computing resources are integrated through the use of GPUs directly mounted on the containers., The work in this article has been co-funded by project ATMOSPHERE, funded jointly by the European Commission under the Cooperation Programme, Horizon 2020 grant agreement No 777154 and the Brazilian Ministerio de Ci ¿ encia, Tecnologia e ¿ Inovac¿ao (MCTI), number 51119. ¿ The authors also want to acknowledge the research grant from the regional government of the Comunitat Valenciana (Spain), co-funded by the European Union ERDF funds (European Regional Development Fund) of the Comunitat Valenciana 2014- 2020, with reference IDIFEDER/2018/032 (HighPerformance Algorithms for the Modelling, Simulation and early Detection of diseases in Personalized Medicine).
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publication Artículo científico (JournalArticle)

Accelerated serverless computing based on GPU virtualization

  • Naranjo-Delgado, Diana María
  • Risco, Sebastián
  • Pérez-González, Alfonso María
  • Alfonso Laguna, Carlos De|||0000-0002-2378-021X
  • Blanquer Espert, Ignacio|||0000-0003-1692-8922
  • Moltó, Germán|||0000-0002-8049-253X
[EN] This paper introduces a platform to support serverless computing for scalable event-driven data processing that features a multi-level elasticity approach combined with virtualization of GPUs. The platform supports the execution of applications based on Docker containers in response to file uploads to a data storage in order to perform the data processing in parallel. This is managed by an elastic Kubernetes cluster whose size automatically grows and shrinks depending on the number of files to be processed. To accelerate the processing time of each file, several approaches involving virtualized access to GPUs, either locally or remote, have been evaluated. A use case that involves the inference based on deep learning techniques on transtoracic echocardiography imaging has been carried out to assess the benefits and limitations of the platform. The results indicate that the combination of serverless computing and GPU virtualization introduce an efficient and cost-effective event-driven accelerated computing approach that can be applied for a wide variety of scientific applications., The work presented in this article has been partially funded by a research grant from the regional government of the Comunitat Valenciana (Spain), co-funded by the European Union ERDF funds (European Regional Development Fund) of the Comunitat Valenciana 2014-2020, with reference IDIFEDER/2018/032 (High-Performance Algorithms for the Modeling, Simulation and early Detection of diseases in Personalized Medicine). The authors would also like to thank the Spanish "Ministerio de Economia, Industria y Competitividad" for the project "BigCLOE" with reference number TIN2016-79951-R and the project ATMOSPHERE, funded jointly by the European Commission under the Cooperation Programme, Horizon 2020 grant agreement No 777154 and the Brazilian Ministerio de Ciencia, Tecnologia e Inovacao (MCI-I), number 51119. D.M.N would like to thank the "Generalitat Valenciana, Spain" for the grant GrisoliaP/2017/071.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publication Contribución de congreso (ConferenceOutput)

Easing the Deployment and Management of Cloud Federated Networks Across Virtualised Clusters

  • Andrade Castañeda, Ivan
  • Blanquer Espert, Ignacio|||0000-0003-1692-8922
  • Alfonso Laguna, Carlos De|||0000-0002-2378-021X
[EN] Cloud federation, in the last years, has grown rapidly in literature because to its multiple advantages to coordinate and re-use different services across multiple sites, different geographic locations or cloud providers. This article presents a federated network architecture and focuses on the multi-tenant overlay networks creation across different sites, as well as, the inter-site migration of virtual machines, introducing a framework that allows us to manage our federate cloud environment in three scenarios: distribution of Virtual Machines, resource management, and network management., This work is supported by SENESCYT (Secretaría de Educacion Superior, Ciencia, Tecnología e Innovacion - Ecuador) and partially funded by the ATMOSPHERE Project (funded by the European Commission under the Cooperation Programme, Horizon 2020 grant agreement No 777154).
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Artículo científico (JournalArticle)

Upgrading a high performance computing environment for massive data processing

  • Ponce, Lucas M.
  • Dos Santos, Walter
  • Meira, Wagner
  • Guedes, Dorgival
  • Lezzi, Daniele
  • Badia, Rosa M.
© The Author(s)., High-performance computing (HPC) and massive data processing (Big Data) are two trends that are beginning to converge. In that process, aspects of hardware architectures, systems support and programming paradigms are being revisited from both perspectives. This paper presents our experience on this path of convergence with the proposal of a framework that addresses some of the programming issues derived from such integration. Our contribution is the development of an integrated environment that integretes (i) COMPSs, a programming framework for the development and execution of parallel applications for distributed infrastructures; (ii) Lemonade, a data mining and analysis tool; and (iii) HDFS, the most widely used distributed file system for Big Data systems. To validate our framework, we used Lemonade to create COMPSs applications that access data through HDFS, and compared them with equivalent applications built with Spark, a popular Big Data framework. The results show that the HDFS integration benefits COMPSs by simplifying data access and by rearranging data transfer, reducing execution time. The integration with Lemonade facilitates COMPSs’s use and may help its popularization in the Data Science community, by providing efficient algorithm implementations for experts from the data domain that want to develop applications with a higher level abstraction., This work was partially funded by Fapemig, CAPES, CNPq, MCT/CNPq-InWeb, FAPEMIG-PRONEX-MASWeb (APQ-01400-14), and by the collaboration between Brazilian MCT/RNP and the European Union Horizon 2020 research and innovation programme under grants 690116 (EUBra-BIGSEA) and 777154 (EUBra Atmosphere)., Peer reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Extension of a task-based model to functional programming

  • Ponce, Lucas M.
  • Lezzi, Daniele|||0000-0001-5081-7244
  • Badia Sala, Rosa Maria|||0000-0003-2941-5499
  • Guedes, Dorgival
Recently, efforts have been made to bring together the areas of high-performance computing (HPC) and massive data processing (Big Data). Traditional HPC frameworks, like COMPSs, are mostly task-based, while popular big-data environments, like Spark, are based on functional programming principles. The earlier are know for their good performance for regular, matrix-based computations; on the other hand, for fine-grained, data-parallel workloads, the later has often been considered more successful. In this paper we present our experience with the integration of some dataflow techniques into COMPSs, a task-based framework, in an effort to bring together the best aspects of both worlds. We present our API, called DDF, which provides a new data abstraction that addresses the challenges of integrating Big Data application scenarios into COMPSs. DDF has a functional-based interface, similar to many Data Science tools, that allows us to use dynamic evaluation to adapt the task execution in runtime. Besides the performance optimization it provides, the API facilitates the development of applications by experts in the application domain. In this paper we evaluate DDF's effectiveness by comparing the resulting programs to their original versions in COMPSs and Spark. The results show that DDF can improve COMPSs execution time and even outperform Spark in many use cases., This work was partially supported by CAPES, CNPq, Fapemig and NIC.BR, and by projects Atmosphere (H2020-EU.2.1.1 777154) and INCT-Cyber., Peer Reviewed
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Extension of a task-based model to functional programming

  • Ponce, Lucas M.
  • Lezzi, Daniele
  • Badia Sala, Rosa Maria
  • Guedes, Dorgival
Recently, efforts have been made to bring together the areas of high-performance computing (HPC) and massive data processing (Big Data). Traditional HPC frameworks, like COMPSs, are mostly task-based, while popular big-data environments, like Spark, are based on functional programming principles. The earlier are know for their good performance for regular, matrix-based computations; on the other hand, for fine-grained, data-parallel workloads, the later has often been considered more successful. In this paper we present our experience with the integration of some dataflow techniques into COMPSs, a task-based framework, in an effort to bring together the best aspects of both worlds. We present our API, called DDF, which provides a new data abstraction that addresses the challenges of integrating Big Data application scenarios into COMPSs. DDF has a functional-based interface, similar to many Data Science tools, that allows us to use dynamic evaluation to adapt the task execution in runtime. Besides the performance optimization it provides, the API facilitates the development of applications by experts in the application domain. In this paper we evaluate DDF's effectiveness by comparing the resulting programs to their original versions in COMPSs and Spark. The results show that DDF can improve COMPSs execution time and even outperform Spark in many use cases., This work was partially supported by CAPES, CNPq, Fapemig and NIC.BR, and by projects Atmosphere (H2020-EU.2.1.1 777154) and INCT-Cyber., Peer Reviewed, Postprint (author's final draft)