Pasar al contenido principal

Resultados relacionados

Resultados totales (Incluyendo duplicados): 29
Encontrada(s) 1 página(s)

RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Automatic memory-based vertical elasticity and oversubscription on cloud platforms

  • Moltó, Germán|||0000-0002-8049-253X
  • Caballer Fernández, Miguel|||0000-0001-9393-3077
  • Alfonso Laguna, Carlos De|||0000-0002-2378-021X
Hypervisors and Operating Systems support vertical elasticity techniques such as memory ballooning to dynamically assign the memory of Virtual Machines (VMs). However, current Cloud Management Platforms (CMPs), such as OpenNebula or OpenStack, do not currently support dynamic vertical elasticity. This paper describes a system that integrates with the CMP to provide automatic vertical elasticity to adapt the memory size of the VMs to their current memory consumption, featuring live migration to prevent overload scenarios, without downtime for the VMs. This enables an enhanced VM-per-host consolidation ratio while maintaining the Quality of Service for VMs, since their memory is dynamically increased as necessary. The feasibility of the development is assessed via two case studies based on OpenNebula featuring (i) horizontal and vertical elastic virtual clusters on a production Grid infrastructure and (ii) elastic multi-tenant VMs that run Docker containers coupled with live migration techniques. The results show that memory oversubscription can be integrated on CMPs to deliver automatic memory management without severely impacting the performance of the VMs. This results in a memory management framework for on-premises Clouds that features live migration to safely enable transient oversubscription of physical resources in a CMP. © 2015 Elsevier B.V. All rights reserved., The authors would like to thank the Spanish "Ministerio de Economia y Competitividad" for the project CLUVIEM (TIN2013-44390-R) and the European Commission for the project INDIGO-DataCloud with grant number 653549.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Orchestrating Complex Application Architectures in Heterogeneous Clouds

  • Caballer Fernández, Miguel|||0000-0001-9393-3077
  • Moltó, Germán|||0000-0002-8049-253X
  • Zala, Sahdev
  • López, Álvaro
  • Orviz, Pablo
  • Velten, Mathieu
[EN] Private cloud infrastructures are now widely deployed and adopted across technology industries and research institutions. Although cloud computing has emerged as a reality, it is now known that a single cloud provider cannot fully satisfy complex user requirements. This has resulted in a growing interest in developing hybrid cloud solutions that bind together distinct and heterogeneous cloud infrastructures. In this paper we describe the orchestration approach for heterogeneous clouds that has been implemented and used within the INDIGO-DataCloud project. This orchestration model uses existing open-source software like OpenStack and leverages the OASIS Topology and Specification for Cloud Applications (TOSCA) open standard as the modeling language. Our approach uses virtual machines and Docker containers in an homogeneous and transparent way providing consistent application deployment for the users. This approach is illustrated by means of two different use cases in different scientific communities, implemented using the INDIGO-DataCloud solutions., The authors want to acknowledge the support of the INDIGO-Datacloud (grant number 653549) project, funded by the European Commission's Horizon 2020 Framework Program.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

INDIGO-DataCloud: a Platform to Facilitate Seamless Access to E-Infrastructures

  • Salomoni, Davide
  • Campos, Isabel
  • Gaido, Luciano
  • Marco, Jesus
  • Solagna, P.
  • Gomes, Jorge
  • Matyska, L.
  • Fuhrmann, Patrick
  • Hardt, M.
  • Donvito, G.
  • Dutka, Lukasz
  • Plociennik, Marcin
  • Barbera, Roberto
  • Ceccanti, A.
  • Cetinic, E.
  • David, Mário
  • Duma, C.
  • López, Álvaro
  • Blanquer Espert, Ignacio|||0000-0003-1692-8922
  • Moltó, Germán|||0000-0002-8049-253X
[EN] This paper describes the achievements of the H2020 project INDIGO-DataCloud. The project has provided e-infrastructures with tools, applications and cloud framework enhancements to manage the demanding requirements of scientific communities, either locally or through enhanced interfaces. The middleware developed allows to federate hybrid resources, to easily write, port and run scientific applications to the cloud. In particular, we have extended existing PaaS (Platform as a Service) solutions, allowing public and private e-infrastructures, including those provided by EGI, EUDAT, and Helix Nebula, to integrate their existing services and make them available through AAI services compliant with GEANT interfederation policies, thus guaranteeing transparency and trust in the provisioning of such services. Our middleware facilitates the execution of applications using containers on Cloud and Grid based infrastructures, as well as on HPC clusters. Our developments are freely downloadable as open source components, and are already being integrated into many scientific applications., INDIGO-Datacloud has been funded by the European Commision H2020 research and innovation program under grant agreement RIA 653549.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Increasing the Efficiency on Producing Radiology Reports for Breast Cancer Diagnosis by Means of Structured Reports

  • Segrelles Quilis, José Damián|||0000-0001-5698-7965
  • Blanquer Espert, Ignacio|||0000-0003-1692-8922
  • Medina, Rosana
  • Marti Bonmati, Luis
Background: Radiology reports are commonly written on free-text using voice recognition devices. Structured reports (SR) have a high potential but they are usually considered more difficult to fill-in so their adoption in clinical practice leads to a lower efficiency. However, some studies have demonstrated that in some cases, producing SRs may require shorter time than plain-text ones. This work focuses on the definition and demonstration of a methodology to evaluate the productivity of software tools for producing radiology reports. A set of SRs for breast cancer diagnosis based on BI-RADS have been developed using this method. An analysis of their efficiency with respect to free-text reports has been performed. Material and Methods: The methodology proposed compares the Elapsed Time (ET) on a set of radiological reports. Free-text reports are produced with the speech recognition devices used in the clinical practice. Structured reports are generated using a web application generated with TRENCADIS framework. A team of six radiologists with three different levels of experience in the breast cancer diagnosis was recruited. These radiologists performed the evaluation, each one introducing 50 reports for mammography, 50 for ultrasound scan and 50 for MRI using both approaches. Also, the Relative Efficiency (REF) was computed for each report, dividing the ET of both methods. We applied the T-Student (T-S) test to compare the ETs and the ANOVA test to compare the REFs. Both tests were computed using the SPSS software. Results: The study produced three DICOM-SR templates for Breast Cancer Diagnosis on mammography, ultrasound and MRI, using RADLEX terms based on BIRADs 5th edition. The T-S test on radiologists with high or intermediate profile, showed that the difference between the ET was only statistically significant for mammography and ultrasound. The ANOVA test performed grouping the REF by modalities, indicated that there were no significant differences between mammograms and ultrasound scans, but both have significant statistical differences with MRI. The ANOVA test of the REF for each modality, indicated that there were only significant differences in Mammography (ANOVA p = 0.024) and Ultrasound (ANOVA p = 0.008). The ANOVA test for each radiologist profile, indicated that there were significant differences on the high profile (ANOVA p = 0.028) and medium (ANOVA p = 0.045). Conclusions: In this work, we have defined and demonstrated a methodology to evaluate the productivity of software tools for producing radiology reports in Breast Cancer. We have evaluated that adopting Structured Reporting in mammography and ultrasound studies in breast cancer diagnosis improves the performance in producing reports., INDIGO - DataCloud receives funding from the European Union's Horizon 2020 research and innovation programme under grant agreement RIA 653549.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

TOSCA-based orchestration of complex clusters at the IaaS level

  • Caballer Fernández, Miguel|||0000-0001-9393-3077
  • Moltó, Germán|||0000-0002-8049-253X
  • Donvito, Giacinto
  • Rocha, Ricardo
  • Velten, Mathieu
[EN] This paper describes the adoption and extension of the TOSCA standard by the INDIGO-DataCloud project for the definition and deployment of complex computing clusters together with the required support in both OpenStack and OpenNebula, carried out in close collaboration with industry partners such as IBM. Two examples of these clusters are described in this paper, the definition of an elastic computing cluster to support the Galaxy bioinformatics application where the nodes are dynamically added and removed from the cluster to adapt to the workload, and the definition of an scalable Apache Mesos cluster for the execution of batch jobs and support for long-running services. The coupling of TOSCA with Ansible Roles to perform automated installation has resulted in the definition of high-level, deterministic templates to provision complex computing clusters across different Cloud sites., The authors would like to thank the European Commission for the financial support for project INDIGO-DataCloud (RIA 653549)
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Otros (Other)

An integrated IaaS and PaaS architecture for scientific computing

  • Donvito, Giacinto
  • Blanquer, Ignacio
Trabajo presentado al EGI Community Forum, celebrado en Bari (Italia) del 10 al 13 de noviembre de 2015., Scientific applications often require multiple computing resources deployed on a coordinated way. The deployment of multiple resources require installing and configuring special software applications which should be updated when changes in the virtual infrastructure take place. When working on hybrid and federated cloud environments, restrictions on the hypervisor or cloud management platform must be minimised to facilitate geographic-wide brokering and cross-site deployments. Moreover, preserving the individual operation at the site-level in federated clouds is also important for scalability and interoperability. In that sense, the INDIGO-DataCloud project [1] has been designed with the objective of building up a PaaS-level cloud solution for research. One of the key multi-level components is the PaaS computing core. This part constitutes the kernel for the deployment of services and computing virtual infrastructures for the users. It is complemented with the virtualized storage, federated AAI and networking. The INDIGO-DataCloud PaaS core will be based on a microservice architecture [2]. Microservices consist of a set of narrowly focused, independently deployable services, typically implemented using container-embedded applications, exposed by RESTful interface. Microservices are designed to be highly scalable, highly available and targeted for the use in cloud environments. INDIGO's microservices will be deployed, dynamically scheduled and managed using tools such as kubernetes [3]. In cases where multi-tenancy is not yet intrinsically supported by the particular microservice, like the container manager, INDIGO-DataCloud may decide to offer multiple instances to bridge that gap. INDIGO PaaS will offer an upper layer orchestration service for distributed applications using the TOSCA language standard [4]. It will deal with the requested service instantiation and application execution, managing the needed microservices in order, for example, to select the right end-point for the deployment. Cross-site deployments will also be possible. This PaaS, aimed at providing a more efficient platform for scientific computing, will require additional characteristics from the underlying layers. The INDIGO PaaS will leverage an enhanced IaaS that will provide a richer set of features currently missing. The usage of TOSCA permits IaaS providers to offer infrastructure orchestration, making possible to manage the deployment and configuration of the resources that are being provided. The life-cycle of the resources is therefore managed through the APIs exposed by the IaaS end-points. The TOSCA templates will be translated into their native deployment schemas using IM [5] for OpenNebula and Heat-Translator [6] for OpenStack HEAT. Both OpenNebula and OpenStack will incorporate drivers to support the deployment of containers as first-class resources on the IaaS. This will provide high efficiency when building up complex configurations from a repository of container images. The scheduling algorithms for both cloud management frameworks will be improved, in order to provide a better experience for the end-users and a more efficient utilization of the computational resources. The usage of two-level orchestrator (at the level of PaaS and within each IaaS instances) will enhance the capabilities of providing a dynamic and on-demand increase in cloud resources, Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Otros (Other)

Open Data: the perspective from INDIGO - DataCloud based on application requirements

  • Marco, Jesús
Trabajo presentado a la EGI Conference: "Engaging the Research Community towards an Open Science Commons", celebrada en Lisboa (Portugal) del 18 al 22 de mayo de 2015., The process to define the requirements of the applications of the different research communities to be deployed in a Cloud framework is presented. The points related to the use of Open Data are explored, including preservation and knowledge integration., Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Otros (Other)

Improving IaaS resources to accommodate scientific applications

  • López-García, Álvaro
  • Fuhrmann, Patrick
  • Donvito, Giacinto
  • Chierici, Andrea
Trabajo presentado al HEPiX Fall 2015 celebrado en Brookhaven National Laboratory (BNL), Upton New York (US) del 12 al 16 de octubre de 2015., INDIGO-DataCloud aims at developing a data and computing platform targeted at scientific communities, integrating existing standards and open software solutions. INDIGO proposes: - to build-up a PaaS solution leveraging existing resources and e-Infrastructures, since the mere access to IaaS resources has been demonstrated as not being a realistic option for most Research Communities. - to improve the virtualization layer provided by already diffed IaaS. In order to build such a Scientific oriented PaaS, several improvements are needed at the IaaS layer. However, the approach of the project is to ensure that those improvements are beneficial enough by their own and not focused on just enabling the upper PaaS layer. Therefore, we find that they can be interesting for the HEP community and for the WLCG in particular. In this presentation we will try to give an overview of the developments that we consider of interest for the HEPiX community, namely: - Container support in Cloud stacks: INDIGO will incorporate specific drivers into the most used cloud management frameworks (i.e. OpenNebula and OpenStack) to support the deployment and execution of containers as first-class resources on the IaaS. - Scheduling improvements: Currently scheduling in most cloud middlewares is based in first-come, first-served policies. The project will develop new intra-cloud scheduling algorithms that are more appropriate for scientific scenarios. Namely we foresee two different and complimentary approaches: a fair-share based scheduling with a queuing mechanism similar to the current batch scheduling and a spot-instances based approach for opportunistic usage. - IaaS orchestration trough standards: We will provide IaaS orchestration using a common standard language (TOSCA) in both OpenStack and OpenNebula, easing the deployment and management of (computing, storage and network) resources at the IaaS layer. - Container integration in batch systems: We will study the possibility of executing containers through batch systems, with the aim of providing the access to specialized hardware (such as Infiniband networks and GPGPUs)., INDIGO-Datacloud RIA-653549., Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Otros (Other)

Community Requirements

  • Campos, Isabel
Trabajo presentado a la ISC Cloud and Big Data Conference, celebrada en Frankfurt (Alemania) del 28 al 30 de septiembre de 2015., INDIGO-DataCloud is co-founded by the Horizon 2020Framework Programme., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Otros (Other)

INDIGO-Datacloud: foundations and architectural description of a Platform as a Service oriented to scientific computing

  • Salomoni, Davide
  • Campos, Isabel
  • Marco, Jesús
  • López-García, Álvaro
  • Orviz, Pablo
Software Engineering.-- et al., In this paper we describe the architecture of a Platform as a Service (PaaS) oriented to computing and data analysis. In order to clarify the choices we made, we explain the features using practical examples, applied to several known usage patterns in the area of HEP computing. The proposed architecture is devised to provide researchers with a unified view of distributed computing infrastructures, focusing in facilitating seamless access. In this respect the Platform is able to profit from the most recent developments for computing and processing large amounts of data, and to exploit current storage and preservation technologies, with the appropriate mechanisms to ensure security and privacy., INDIGO-DataCloud is co-founded by the Horizon 2020Framework Programme., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Otros (Other)

INDIGO MidnightBlue Service Catalogue

  • INDIGO - DataCloud
INDIGO-DataCloud is co-founded by the Horizon 2020Framework Programme., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Contribución de congreso (ConferenceOutput)

INDIGO solutions for multidisciplinary scientific applications

  • INDIGO - DataCloud
INDIGO provides a simplified user experience, allowing easier access and usage of scientific applications by a wide-range of scientific communities., INDIGO-DataCloud is co-founded by the Horizon 2020Framework Programme., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Contribución de congreso (ConferenceOutput)

INDIGO-DataCloud first public release is out!

  • INDIGO - DataCloud
On August 8, 2016 INDIGO-DataCloud project announced the general availability of its first public software release, codenamed MidnightBlue. The release comes after an initial phase of requirement gatherings which involved several European scientific collaborations in areas as diverse as structural biology, earth sciences, physics, bioinformatics, cultural heritage, astrophysics, life sciences, climatology, etc. This resulted in the development of many software components addressing existing technical gaps linked to easy and optimal usage of distributed data and compute resources., INDIGO-DataCloud is co-founded by the Horizon 2020Framework Programme., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Otros (Other)

The first INDIGO-DataCloud software release is out!

  • INDIGO - DataCloud
An unmatched open modular suite of software components for Data and Cloud computing is now available for resource providers and researchers from all disciplines, all around Europe., INDIGO-DataCloud is co-founded by the Horizon 2020Framework Programme., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Contribución de congreso (ConferenceOutput)

Towards asustainable European PaaS-based cloud solution for e-Science

  • INDIGO - DataCloud
INDIGO-DataCloud delivers open source software services tailored to scientific communities and to e-infrastructures, aimed to increase ease of use and effectiveness in the exploitation of Cloud resources by them., INDIGO -DataCloud receives funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement RIA 653549., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Standards for enabling heterogeneous IaaS cloud federations

  • López-García, Álvaro
  • Fernández-del-Castillo, Enol
  • Orviz, Pablo
arXiv:1711.08045v1, Technology market is continuing a rapid growth phase where different resource providers and Cloud Management Frameworks are positioning to provide ad-hoc solutions-as management interfaces, information discovery or billing-trying to differentiate from competitors resulting in incompatibilites between them when addressing more complex scenarios like federated clouds. Therefore, grasping interoperability problems present in current infrastructures by studying how existing and emerging standards could enhance the cloud user experience. In this paper we will review the current open challenges in Infrastructure as a Service cloud interoperability and federation, as well as point to the potential standards that should alleviate these problems., The authors want to acknowledge the support, in no particular order, of the EGI-Engage (grant number 654142) and INDIGO-Datacloud (grant number 653549) projects, funded by the European Commission's Horizon 2020 Framework Programme., Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Orchestrating complex application architectures in heterogeneous clouds

  • Caballer, Miguel
  • Zala, Sahdev
  • López-García, Álvaro
  • Moltó, Germán
  • Orviz, Pablo
  • Velten, Mathieu
arXiv:1711.03334v1, Private cloud infrastructures are now widely deployed and adopted across technology industries and research institutions. Although cloud computing has emerged as a reality, it is now known that a single cloud provider cannot fully satisfy complex user requirements. This has resulted in a growing interest in developing hybrid cloud solutions that bind together distinct and heterogeneous cloud infrastructures. In this paper we describe the orchestration approach for heterogeneous clouds that has been implemented and used within the INDIGO-DataCloud project. This orchestration model uses existing open-source software like OpenStack and leverages the OASIS Topology and Specification for Cloud Applications (TOSCA) open standard as the modeling language. Our approach uses virtual machines and Docker containers in an homogeneous and transparent way providing consistent application deployment for the users. This approach is illustrated by means of two different use cases in different scientific communities, implemented using the INDIGO-DataCloud solutions., The authors want to acknowledge the support of the INDIGO-Datacloud (grant number 653549) project, funded by the European Commission’s Horizon 2020 Framework Program., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Resource provisioning in Science Clouds: Requirements and challenges

  • López-García, Álvaro
  • Fernández-del-Castillo, Enol
  • Orviz, Pablo
  • Campos, Isabel
  • Marco, Jesús
arXiv:1709.08526v1, Cloud computing has permeated into the information technology industry in the last few years, and it is emerging nowadays in scientific environments. Science user communities are demanding a broad range of computing power to satisfy the needs of high-performance applications, such as local clusters, high-performance computing systems, and computing grids. Different workloads are needed from different computational models, and the cloud is already considered as a promising paradigm. The scheduling and allocation of resources is always a challenging matter in any form of computation and clouds are not an exception. Science applications have unique features that differentiate their workloads; hence, their requirements have to be taken into consideration to be fulfilled when building a Science Cloud. This paper will discuss what are the main scheduling and resource allocation challenges for any Infrastructure as a Service provider supporting scientific applications., The authors want to acknowledge the support of the EGI-Engage (grant 654142) and INDIGO-DataCloud (grant 653549)projects, funded by the European Commission's Horizon 2020 Framework Programme., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Contribución de congreso (ConferenceOutput)

Improved Cloud resource allocation: how INDIGO-Datacloud is overcoming the current limitations in Cloud schedulers

  • López-García, Álvaro
  • Zangrando, Lisa
  • Sgaravatto, Massimo
  • Llorens, Vincent
  • Vallero, Sara
  • Zaccolo, Valentina
  • Bagnasco, Stefano
  • Taneja, Sonia
  • Dal Pra, Stefano
  • Salomoni, Davide
  • Donvito, Giacinto
Trabajo presentado a: 22nd International Conference on Computing in High Energy and Nuclear Physics (CHEP2016) 10–14 October 2016, San Francisco., Performing efficient resource provisioning is a fundamental aspect for any resource provider. Local Resource Management Systems (LRMS) have been used in data centers for decades in order to obtain the best usage of the resources, providing their fair usage and partitioning for the users. In contrast, current cloud schedulers are normally based on the immediate allocation of resources on a first-come, first-served basis, meaning that a request will fail if there are no resources (e.g. OpenStack) or it will be trivially queued ordered by entry time (e.g. OpenNebula). Moreover, these scheduling strategies are based on a static partitioning of the resources, meaning that existing quotas cannot be exceeded, even if there are idle resources allocated to other projects. This is a consequence of the fact that cloud instances are not associated with a maximum execution time and leads to a situation where the resources are under-utilized. These facts have been identified by the INDIGO-DataCloud project as being too simplistic for accommodating scientific workloads in an efficient way, leading to an underutilization of the resources, a non desirable situation in scientific data centers. In this work, we will present the work done in the scheduling area during the first year of the INDIGO project and the foreseen evolutions., The authors want to acknowledge the support of the INDIGO-DataCloud (grant number 653549) project, funded by the European Commission’s Horizon 2020 Framework Programme., Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Otros (Other)

A set of common software quality assurance baseline criteria for research projects

  • Orviz, Pablo
  • López-García, Álvaro
  • Duma, Doina Cristina
  • Donvito, Giacinto
  • David, Mario
  • Gomes, Jorge
  • Campos, Isabel
  • Moltó, Germán
  • Tykhonov, Vyacheslav
Update on November 2022., The purpose of this document is to define a set of quality standards, procedures and best practices to conform a Software Quality Assurance plan to serve as a reference within the European research ecosystem related projects for the adequate development and timely delivery of software products., The INDIGO-DataCloud, DEEP-Hybrid-DataCloud and eXtreme-DataCloud projects have received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement number 653549, 777435 and 777367 respectively., No
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Enabling rootless Linux Containers in multi-user environments: The udocker tool

  • Gomes, Jorge
  • Bagnaschi, E.
  • Campos, Isabel
  • David, Mario
  • Alves, Luis
  • Martins, João
  • Pina, Joâo
  • López-García, Álvaro
  • Orviz, Pablo
Containers are increasingly used as means to distribute and run Linux services and applications. In this paper we describe the architectural design and implementation of udocker, a tool which enables the user to execute Linux containers in user mode. We also present a few practical applications, using a range of scientific codes characterized by different requirements: from single core execution to MPI parallel execution and execution on GPGPUs., This work has been performed in the framework of the H2020 project INDIGO-Datacloud (RIA 653549). The work of E.B. is supported by the Collaborative Research Center SFB676 of the DFG, “Particles, Strings and the early Universe”. The proofs of concept presented have been performed at the FinisTerrae II machine provided by CESGA (funded by Xunta de Galicia and MINECO), at the Altamira machine (funded by the University of Cantabria and MINECO) and at the INCD-Infraestrutura Nacional de Computação Distribuída (funded by FCT, P2020, Lisboa2020, COMPETE and FEDER under the project number 22153-01/SAICT/2016)., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

INDIGO-DataCloud: a platform to facilitate seamless access to e-infrastructures

  • Salomoni, Davide
  • Campos, Isabel
  • Gaido, Luciano
  • Marco, Jesús
  • Gomes, Jorge
  • Matyska, Ludek
  • Fuhrmann, Patrick
  • Hardt, Marcus
  • Donvito, Giacinto
  • Plociennik, Marcin
  • Blanquer, Ignacio
  • Ceccanti, Andrea
  • David, Mario
  • Duma, Doina Cristina
  • López-García, Álvaro
  • Moltó, Germán
  • Orviz, Pablo
  • Šustr, Zdenêk
  • Aguilar, Fernando
  • Alves, Lincoln M.
  • Antonacci, Marica
  • Bagnasco, Stefano
  • Lloret Iglesias, Lara
  • Martins, João
  • Pina, Joâo
  • Spiga, Daniele
  • Urbaniak, Michał
  • Vallero, Sara
  • Zaccolo, Valentina
D. Salomoni et al., This paper describes the achievements of the H2020 project INDIGO-DataCloud. The project has provided e-infrastructures with tools, applications and cloud framework enhancements to manage the demanding requirements of scientific communities, either locally or through enhanced interfaces. The middleware developed allows to federate hybrid resources, to easily write, port and run scientific applications to the cloud. In particular, we have extended existing PaaS (Platform as a Service) solutions, allowing public and private e-infrastructures, including those provided by EGI, EUDAT, and Helix Nebula, to integrate their existing services and make them available through AAI services compliant with GEANT interfederation policies, thus guaranteeing transparency and trust in the provisioning of such services. Our middleware facilitates the execution of applications using containers on Cloud and Grid based infrastructures, as well as on HPC clusters. Our developments are freely downloadable as open source components, and are already being integrated into many scientific applications., INDIGO-Datacloud has been funded by the European Commision H2020 research and innovation program under grant agreement RIA 653549., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

ooi: OpenStack OCCI interface

  • López-García, Álvaro
  • Fernández-del-Castillo, Enol
  • Orviz, Pablo
In this document we present an implementation of the Open Grid Forum’s Open Cloud Computing Interface (OCCI) for OpenStack, namely ooi (Openstack occi interface, 2015). OCCI is an open standard for management tasks over cloud resources, focused on interoperability, portability and integration. ooi aims to implement this open interface for the OpenStack cloud middleware, promoting interoperability with other OCCI-enabled cloud management frameworks and infrastructures. ooi focuses on being non-invasive with a vanilla OpenStack installation, not tied to a particular OpenStack release version, The authors want to acknowledge the support of the EGI-Engage (grant number 654142) and INDIGO-Datacloud (grant number 653549) projects, funded by the European Commission’s Horizon 2020 Framework Programme., Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Otros (Other)

ooi: OpenStack OCCI Interface

  • López-García, Álvaro
  • Fernández-del-Castillo, Enol
  • Orviz, Pablo
  • David, Mario
  • Sevilla Cedillo, Jorge
  • Pansanel, Jerome
  • Alves, Luis
Apache License 2.0, January 2004.-- OOI is an implementation the Open Cloud Computing Interface (OCCI) for OpenStack. http://openstack.org, ooi is an implementation the Open Grid Forum's Open Cloud Computing Interface (OCCI) for OpenStack that currently implements the version 1.2 (OCCI 1.2) of the standard., EGI-Engage, GA 654142. INDIGO-DataCloud GA 653549., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

An efficient cloud scheduler design supporting preemptible instances

  • López-García, Álvaro
  • Fernández-del-Castillo, Enol
  • Campos, Isabel
Maximizing resource utilization by performing an efficient resource provisioning is a key factor for any cloud provider: commercial actors can maximize their revenues, whereas scientific and non-commercial providers can maximize their infrastructure utilization. Traditionally, batch systems have allowed data centers to fill their resources as much as possible by using backfilling and similar techniques. However, in an IaaS cloud, where virtual machines are supposed to live indefinitely, or at least as long as the user is able to pay for them, these policies are not easily implementable. In this work we present a new scheduling algorithm for IaaS providers that is able to support preemptible instances, that can be stopped by higher priority requests without introducing large modifications in the current cloud schedulers. This scheduler enables the implementation of new cloud usage and payment models that allow more efficient usage of the resources and potential new revenue sources for commercial providers. We also study the correctness and the performance overhead of the proposed scheduler against existing solutions., The authors acknowledge the financial support from the European Commission Horizon 2020 via INDIGO-DataCloud project (grant number 653549) and EGI-ENGAGE (grant number 654142) and the Ministry of Economy and Competitiveness for the support through the National Plan under contract number FPA2013-40715-P., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Otros (Other)

INDIGO-DC SOFTWARE COLLABORATION AGREEMENT

  • INDIGO - DataCloud
The purpose of this Agreement is to define Parties’ rights and responsibilities regarding the Collaboration. These shall form the fundamental basis of the partnership. This Collaboration has been initiated within the framework of the H2020 funded INDIGO-DataCloud project and shall be continued without financial support from the European Union. It is therefore open to new initiatives and new parties willing to contribute, extend or maintain the INDIGO-DC software components, No
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Software quality assurance in INDIGO-DataCloud project: a converging evolution of software engineering practices to support European research e-infrastructures

  • Orviz, Pablo
  • David, Mario
  • Duma, Doina Cristina
  • Ronchieri, Elisabetta
  • Gomes, Jorge
  • Salomoni, Davide
From the advent of Grid technology - as the new paradigm of distributed computing - to the current days of Cloud computing models, the continuous need of new tools and services to match the scientific community requirements has been addressed in Europe through dedicated software development projects for e-Infrastructure creation, operation and management. This work presents the most signi cant software quality breakthroughs obtained in one of such projects, INDIGO-DataCloud, the main challenges and barriers confronted throughout the lifespan of the project, and how they were partially or totally overcome. The knowledge base established throughout the last 15 years of diverse software development initiatives in Europe for sustaining distributed research e-Infrastructures, supported by the advances in the area of software engineering, de nitely contributed to improve the quality and reliability of the software delivered, and consequently, the operational stability of the European e-Infrastructures. INDIGO-DataCloud project is a good evidence of such insights, where, unlike the preceding trend found in past projects, the enforcement of Software Quality Assurance practices has been present since the very early stages of the software lifecycle., DataGrid - Research and Technological Development for an International Data Grid project has received funding from the European Union's Fifth Framework Programme under grant agreement IST-2000-25182E. EGEE - Enabling grids For E-science project has received funding from the European Union's Sixth Framework Programme under grant agreement INFSO-RI-508833. EGEE - Enabling grids For E-science-II project has received funding from the European Union's Sixth Framework Programme under grant agreement INFSORI031688. EGEE - Enabling grids For E-science-III project has received funding from the European Union's Seventh Framework Programme under grant agreement INFSO-RI-222667. ETICS - E-Infrastructure for Testing, Integration and Configuration of Software project has received funding from the European Union's Sixth Framework Programme under grant agreement INFSO-RI-026753. ETICS - E-Infrastructure for Testing, Integration and Configuration of Software - Phase 2 project has received funding from the European Union's Seventh Framework Programme under grant agreement INFSO-RI-223782. EGI-InSPIRE - European Grid Initiative: Integrated Sustainable Pan-European Infrastructure for Researchers in Europe project has received funding from the European Union's Seventh Framework Programme under grant agreement INFSO-RI-261323. EGI-Engage project has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement RIA-654142. INDIGO-DataCloud project has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement RIA-653549., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Global analysis of dark matter simplified models with leptophobic spin-one mediators using MasterCode

  • Bagnaschi, E.
  • Costa, J. C.
  • Sakurai, K.
  • Borsato, M.
  • Buchmueller, O.
  • Roeck, A. de
  • Dolan, M. J.
  • Ellis, J. R.
  • Flächer, H.
  • Hahn, K.
  • Heinemeyer, Sven
  • Lucio, M.
  • Martínez Santos, D.
  • Olive, K. A.
  • Trifa, S.
  • Weiglein, Georg
We report the results of a global analysis of dark matter simplified models (DMSMs) with leptophobic mediator particles of spin one, considering the cases of both vector and axial-vector interactions with dark matter (DM) particles and quarks. We require the DMSMs to provide all the cosmological DM density indicated by Planck and other observations, and we impose the upper limits on spin-independent and -dependent scattering from direct DM search experiments. We also impose all relevant LHC constraints from searches for monojet events and measurements of the dijet mass spectrum. We model the likelihood functions for all the constraints and combine them within the MasterCode framework, and probe the full DMSM parameter spaces by scanning over the mediator and DM masses and couplings, not fixing any of the model parameters. We find, in general, two allowed regions of the parameter spaces: one in which the mediator couplings to Standard Model (SM) and DM particles may be comparable to those in the SM and the cosmological DM density is reached via resonant annihilation, and one in which the mediator couplings to quarks are ≲10-3 and DM annihilation is non-resonant. We find that the DM and mediator masses may well lie within the ranges accessible to LHC experiments. We also present predictions for spin-independent and -dependent DM scattering, and present specific results for ranges of the DM couplings that may be favoured in ultraviolet completions of the DMSMs., G.W. acknowledges support by the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation) under Germany’s Excellence Strategy – EXC 2121 “Quantum Universe” – 390833306. The work of K.S. has been partially supported by the National Science Centre, Poland, under research grants DEC-2014/15/B/ST2/02157, DEC-2015/18/M/ST2/00054 and DEC2015/19/D/ST2/03136. The work of M.B. and D.M.S. has been supported by the European Research Council via Grant BSMFLEET 639068. The work of J.C.C. is supported by CNPq (Brazil). The work of M.J.D. is supported in part by the Australia Research Council. The work of J.E. is supported in part by STFC (UK) via the research grant ST/L000258/1 and in part via the Estonian Research Council via a Mobilitas Pluss grant, and the work of H.F. is also supported in part by STFC (UK) via grant ST/N000250/1. The work of S.H. is supported in part by the MEINCOP Spain under contract FPA2016-78022-P, in part by the Spanish Agencia Estatal de Investigación (AEI) and the EU Fondo Europeo de Desarrollo Regional (FEDER) through the project FPA2016-78645-P, in part by the AEI through the grant IFT Centro de Excelencia Severo Ochoa SEV-2016-0597, and by the “Spanish Red Consolider Multidark” FPA2017-90566-REDC. The work of M.L. is supported by XuntaGal. The work of K.A.O. is supported in part by DOE grant desc0011842 at the University of Minnesota. During part of this work, to deploy MasterCode on clusters we used the middle-ware suite udocker [97], which was developed by the EC H2020 project INDIGO-Datacloud (RIA 653549). We also thank Imperial College London and the University of Bristol for making available to us cluster computing resources that have been used intensively to carry out this work.
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Contribución de congreso (ConferenceOutput)

Rootless containers with udocker

  • Gomes, Jorge
  • David, Mario
  • Martins, João
  • Campos, Isabel
  • López-García, Álvaro
  • Orviz, Pablo
  • Kozlov, Valentin
Trabajo presentado al ISC High Performance, celebrado en Frankfurt (Alemania) del 16 al 20 de junio de 2019., This work was developed with the support of the H2020 projects: INDIGO-DataCloud (RIA 653549), DEEP-Hybrid-DataCloud, (RIA 777435), EOSC-hub (RIA 777536). This work was developed with the support of the Portuguese Foundation for Science and Technology under the project: Infraestrutura Nacional de Computação Distribuída 01/SAICT/2016 - nº 02215