Skip to main content

Resultados relacionados

Resultados totales (Incluyendo duplicados): 10
Encontrada(s) 1 página(s)

DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Otros (Other)

An integrated IaaS and PaaS architecture for scientific computing

  • Donvito, Giacinto
  • Blanquer, Ignacio
Trabajo presentado al EGI Community Forum, celebrado en Bari (Italia) del 10 al 13 de noviembre de 2015., Scientific applications often require multiple computing resources deployed on a coordinated way. The deployment of multiple resources require installing and configuring special software applications which should be updated when changes in the virtual infrastructure take place. When working on hybrid and federated cloud environments, restrictions on the hypervisor or cloud management platform must be minimised to facilitate geographic-wide brokering and cross-site deployments. Moreover, preserving the individual operation at the site-level in federated clouds is also important for scalability and interoperability. In that sense, the INDIGO-DataCloud project [1] has been designed with the objective of building up a PaaS-level cloud solution for research. One of the key multi-level components is the PaaS computing core. This part constitutes the kernel for the deployment of services and computing virtual infrastructures for the users. It is complemented with the virtualized storage, federated AAI and networking. The INDIGO-DataCloud PaaS core will be based on a microservice architecture [2]. Microservices consist of a set of narrowly focused, independently deployable services, typically implemented using container-embedded applications, exposed by RESTful interface. Microservices are designed to be highly scalable, highly available and targeted for the use in cloud environments. INDIGO's microservices will be deployed, dynamically scheduled and managed using tools such as kubernetes [3]. In cases where multi-tenancy is not yet intrinsically supported by the particular microservice, like the container manager, INDIGO-DataCloud may decide to offer multiple instances to bridge that gap. INDIGO PaaS will offer an upper layer orchestration service for distributed applications using the TOSCA language standard [4]. It will deal with the requested service instantiation and application execution, managing the needed microservices in order, for example, to select the right end-point for the deployment. Cross-site deployments will also be possible. This PaaS, aimed at providing a more efficient platform for scientific computing, will require additional characteristics from the underlying layers. The INDIGO PaaS will leverage an enhanced IaaS that will provide a richer set of features currently missing. The usage of TOSCA permits IaaS providers to offer infrastructure orchestration, making possible to manage the deployment and configuration of the resources that are being provided. The life-cycle of the resources is therefore managed through the APIs exposed by the IaaS end-points. The TOSCA templates will be translated into their native deployment schemas using IM [5] for OpenNebula and Heat-Translator [6] for OpenStack HEAT. Both OpenNebula and OpenStack will incorporate drivers to support the deployment of containers as first-class resources on the IaaS. This will provide high efficiency when building up complex configurations from a repository of container images. The scheduling algorithms for both cloud management frameworks will be improved, in order to provide a better experience for the end-users and a more efficient utilization of the computational resources. The usage of two-level orchestrator (at the level of PaaS and within each IaaS instances) will enhance the capabilities of providing a dynamic and on-demand increase in cloud resources, Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Otros (Other)

Open Data: the perspective from INDIGO - DataCloud based on application requirements

  • Marco, Jesús
Trabajo presentado a la EGI Conference: "Engaging the Research Community towards an Open Science Commons", celebrada en Lisboa (Portugal) del 18 al 22 de mayo de 2015., The process to define the requirements of the applications of the different research communities to be deployed in a Cloud framework is presented. The points related to the use of Open Data are explored, including preservation and knowledge integration., Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Otros (Other)

Improving IaaS resources to accommodate scientific applications

  • López-García, Álvaro
  • Fuhrmann, Patrick
  • Donvito, Giacinto
  • Chierici, Andrea
Trabajo presentado al HEPiX Fall 2015 celebrado en Brookhaven National Laboratory (BNL), Upton New York (US) del 12 al 16 de octubre de 2015., INDIGO-DataCloud aims at developing a data and computing platform targeted at scientific communities, integrating existing standards and open software solutions. INDIGO proposes: - to build-up a PaaS solution leveraging existing resources and e-Infrastructures, since the mere access to IaaS resources has been demonstrated as not being a realistic option for most Research Communities. - to improve the virtualization layer provided by already diffed IaaS. In order to build such a Scientific oriented PaaS, several improvements are needed at the IaaS layer. However, the approach of the project is to ensure that those improvements are beneficial enough by their own and not focused on just enabling the upper PaaS layer. Therefore, we find that they can be interesting for the HEP community and for the WLCG in particular. In this presentation we will try to give an overview of the developments that we consider of interest for the HEPiX community, namely: - Container support in Cloud stacks: INDIGO will incorporate specific drivers into the most used cloud management frameworks (i.e. OpenNebula and OpenStack) to support the deployment and execution of containers as first-class resources on the IaaS. - Scheduling improvements: Currently scheduling in most cloud middlewares is based in first-come, first-served policies. The project will develop new intra-cloud scheduling algorithms that are more appropriate for scientific scenarios. Namely we foresee two different and complimentary approaches: a fair-share based scheduling with a queuing mechanism similar to the current batch scheduling and a spot-instances based approach for opportunistic usage. - IaaS orchestration trough standards: We will provide IaaS orchestration using a common standard language (TOSCA) in both OpenStack and OpenNebula, easing the deployment and management of (computing, storage and network) resources at the IaaS layer. - Container integration in batch systems: We will study the possibility of executing containers through batch systems, with the aim of providing the access to specialized hardware (such as Infiniband networks and GPGPUs)., INDIGO-Datacloud RIA-653549., Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Otros (Other)

Community Requirements

  • Campos, Isabel
Trabajo presentado a la ISC Cloud and Big Data Conference, celebrada en Frankfurt (Alemania) del 28 al 30 de septiembre de 2015., INDIGO-DataCloud is co-founded by the Horizon 2020Framework Programme., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Otros (Other)

INDIGO-Datacloud: foundations and architectural description of a Platform as a Service oriented to scientific computing

  • Salomoni, Davide
  • Campos, Isabel
  • Marco, Jesús
  • López-García, Álvaro
  • Orviz, Pablo
Software Engineering.-- et al., In this paper we describe the architecture of a Platform as a Service (PaaS) oriented to computing and data analysis. In order to clarify the choices we made, we explain the features using practical examples, applied to several known usage patterns in the area of HEP computing. The proposed architecture is devised to provide researchers with a unified view of distributed computing infrastructures, focusing in facilitating seamless access. In this respect the Platform is able to profit from the most recent developments for computing and processing large amounts of data, and to exploit current storage and preservation technologies, with the appropriate mechanisms to ensure security and privacy., INDIGO-DataCloud is co-founded by the Horizon 2020Framework Programme., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Otros (Other)

INDIGO MidnightBlue Service Catalogue

  • INDIGO - DataCloud
INDIGO-DataCloud is co-founded by the Horizon 2020Framework Programme., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Otros (Other)

The first INDIGO-DataCloud software release is out!

  • INDIGO - DataCloud
An unmatched open modular suite of software components for Data and Cloud computing is now available for resource providers and researchers from all disciplines, all around Europe., INDIGO-DataCloud is co-founded by the Horizon 2020Framework Programme., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Otros (Other)

A set of common software quality assurance baseline criteria for research projects

  • Orviz, Pablo
  • López-García, Álvaro
  • Duma, Doina Cristina
  • Donvito, Giacinto
  • David, Mario
  • Gomes, Jorge
  • Campos, Isabel
  • Moltó, Germán
  • Tykhonov, Vyacheslav
Update on November 2022., The purpose of this document is to define a set of quality standards, procedures and best practices to conform a Software Quality Assurance plan to serve as a reference within the European research ecosystem related projects for the adequate development and timely delivery of software products., The INDIGO-DataCloud, DEEP-Hybrid-DataCloud and eXtreme-DataCloud projects have received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement number 653549, 777435 and 777367 respectively., No
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Otros (Other)

ooi: OpenStack OCCI Interface

  • López-García, Álvaro
  • Fernández-del-Castillo, Enol
  • Orviz, Pablo
  • David, Mario
  • Sevilla Cedillo, Jorge
  • Pansanel, Jerome
  • Alves, Luis
Apache License 2.0, January 2004.-- OOI is an implementation the Open Cloud Computing Interface (OCCI) for OpenStack. http://openstack.org, ooi is an implementation the Open Grid Forum's Open Cloud Computing Interface (OCCI) for OpenStack that currently implements the version 1.2 (OCCI 1.2) of the standard., EGI-Engage, GA 654142. INDIGO-DataCloud GA 653549., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Otros (Other)

INDIGO-DC SOFTWARE COLLABORATION AGREEMENT

  • INDIGO - DataCloud
The purpose of this Agreement is to define Parties’ rights and responsibilities regarding the Collaboration. These shall form the fundamental basis of the partnership. This Collaboration has been initiated within the framework of the H2020 funded INDIGO-DataCloud project and shall be continued without financial support from the European Union. It is therefore open to new initiatives and new parties willing to contribute, extend or maintain the INDIGO-DC software components, No