Pasar al contenido principal

Resultados relacionados

Resultados totales (Incluyendo duplicados): 5
Encontrada(s) 1 página(s)

RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Contribución de congreso (ConferenceOutput)

Running HTC and HPC applications opportunistically across private, academic and public clouds

  • Lahiff, Andrew
  • de Witt, Shaun
  • La Rocca, Giuseppe
  • Pamela,Stanislas
  • Coster, David
  • Caballer Fernández, Miguel|||0000-0001-9393-3077
[EN] The Fusion Science Demonstrator in the European Open Science Cloud for Research Pilot Project aimed to demonstrate that the fusion community can make use of distributed cloud resources. We developed a platform, Prominence, which enables users to transparently exploit idle cloud resources for running scientific workloads. In addition to standard HTC jobs, HPC jobs such as multi-node MPI are supported. All jobs are run in containers to ensure they will reliably run anywhere and are reproduceable. Cloud infrastructure is invisible to users, as all provisioning, including extensive failure handling, is completely automated. On-premises cloud resources can be utilised and at times of peak demand burst onto external clouds. In addition to the traditional ¿cloud-bursting¿ onto a single cloud, Prominence allows for bursting across many clouds in a hierarchical manner. Job requirements are taken into account, so jobs with special requirements, e.g. high memory or access to GPUs, are sent only to appropriate clouds. Here we describe Prominence, its architecture, the challenges of using many clouds opportunistically and report on our experiences with several fusion use cases., The European Open Science Cloud for Research pilot project was funded by the European Commission, DG Research & Innovation under contract no. 739563. This work benefited from services and resources provided by the fedcloud.egi.eu Virtual Organization, supported by the national resource providers of the EGI Federation. We acknowledge computing resources supplied by the IRIS (STFC) Consortium.
Dipòsit Digital de la UB
Publicación Artículo científico (JournalArticle)

Butler enables rapid cloud-based analysis of thousands of human genomes

  • PCAWG Technical Working Group
  • PCAWG Consortium
  • Gelpí Buchaca, Josep Lluís
We present Butler, a computational tool that facilitates large-scale genomic analyses on public and academic clouds. Butler includes innovative anomaly detection and self-healing functions that improve the efficiency of data processing and analysis by 43% compared with current approaches. Butler enabled processing of a 725-terabyte cancer genome dataset from the Pan-Cancer Analysis of Whole Genomes (PCAWG) project in a time-efficient and uniform manner.
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Using Scipion for stream image processing at Cryo-EM facilities

  • Gómez-Blanco, Josué
  • Rosa-Trevín, J. M. de la
  • Marabini, Roberto
  • Caño, Laura del
  • Jiménez, A.
  • Martínez, Marta
  • Melero, Roberto
  • Majtner, T.
  • Maluenda, D.
  • Mota, J.
  • Rancel, Y.
  • Ramírez-Aportela, Erney
  • Vilas, J. L.
  • Carroni, M.
  • Fleischmann, S.
  • Lindahl, E.
  • Ashton, A. W.
  • Basham, M.
  • Clare, D. K.
  • Savage, K.
  • Siebert, C. A.
  • Sharov, G. G.
  • Sorzano, Carlos Óscar S.
  • Conesa Mingo, Pablo
  • Carazo, José M.
Three dimensional electron microscopy is becoming a very data-intensive field in which vast amounts of experimental images are acquired at high speed. To manage such large-scale projects, we had previously developed a modular workflow system called Scipion (de la Rosa-Trevín et al., 2016). We present here a major extension of Scipion that allows processing of EM images while the data is being acquired. This approach helps to detect problems at early stages, saves computing time and provides users with a detailed evaluation of the data quality before the acquisition is finished. At present, Scipion has been deployed and is in production mode in seven Cryo-EM facilities throughout the world., Spanish Ministry of Economy and Competitiveness through Grants BIO2016-76400R(AEI/FEDER, UE) and AEI/FEDER BFU 2016 74868P, the Comunidad Autónoma de Madrid through Grant: S2017/BMD-3817, European Union (EU) and Horizon 2020 through grant Corbel (INFRADEV-1-2014-1, Proposal: 654248). The “Knut & Alice Wallenberg Foundation”, and “A Pilot Facility development grant from Science for Life Laboratory”. European Union (EU) and Horizon 2020 through grant EOSCpilot (INFRADEV-04-2016, Proposal: 739563).This work used the EGI Infrastructure and is co-funded by the EGIEngage project (Horizon 2020) under Grant No. 654142. European Union (EU) and Horizon 2020 through grant West-Life (EINFRA-2015-1, Proposal: 675858) European Union (EU) and Horizon 2020 through grant Elixir - EXCELERATE (INFRADEV-3-2015, Proposal: 676559) European Union (EU) and Horizon 2020 through grant iNEXT (INFRAIA-1-2014-2015, Proposal: 653706)., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Measurement of local resolution in electron tomography

  • Vilas, J. L.
  • Otón, Joaquín
  • Messaoudi, C.
  • Melero, Roberto
  • Conesa Mingo, Pablo
  • Ramírez-Aportela, Erney
  • Mota, J.
  • Martínez, Marta
  • Jiménez, A.
  • Marabini, Roberto
  • Carazo, José M.
  • Vargas, Javier
  • Sorzano, Carlos Óscar S.
Resolution (global and local) is one of the most reported metrics of quality measurement in Single Particle Analysis (SPA). However, in electron tomography, the situation is different and its computation is not straightforward. Typically, resolution estimation is global and, therefore, reduces the assessment of a whole tomogram to a single number. However, it is known that tomogram quality is spatially variant. Still, up to our knowledge, a method to estimate local quality metrics in tomography is lacking. This work introduces MonoTomo, a method developed to estimate locally in a tomogram the highest reliable frequency component, expressed as a form of local resolution. The fundamentals lie in a local analysis of the density map via monogenic signals, which, in analogy to MonoRes, allows for local estimations. Results with experimental data show that the local resolution range that MonoTomo casts agrees with reported resolution values for experimental data sets, with the advantage of providing a local estimation. A range of applications of MonoTomo are suggested for further exploration., The author would like to express their gratitude to Dr. J.J. Fernandez for his interest, following and advice on this work. The authors would like to acknowledge economical support from The Spanish Ministry of Economy and Competitiveness through Grants BIO2016-76400-R(AEI/FEDER, UE), the “Comunidad Autónoma de Madrid” through Grant: S2017/BMD-3817, and the European Union (EU) and Horizon 2020 through grant EOSCpilot (INFRADEV-04-2016, Proposal: 739563), INSTRUCT - ULTRA (INFRADEV-03-2016-2017, Proposal: 731005), EOSC-LIFE (INFRAEOSC-04-2018, Proposal: 824087) and HighResCells (ERC-2018-SyG, Proposal: 810057). The authors acknowledge the support and the use of resources of Instruct-ERIC.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Butler enables rapid cloud-based analysis of thousands of human genomes

  • PCAWG Technical Working Group
  • PCAWG Consortium
  • Gelpí Buchaca, Josep Lluís
We present Butler, a computational tool that facilitates large-scale genomic analyses on public and academic clouds. Butler includes innovative anomaly detection and self-healing functions that improve the efficiency of data processing and analysis by 43% compared with current approaches. Butler enabled processing of a 725-terabyte cancer genome dataset from the Pan-Cancer Analysis of Whole Genomes (PCAWG) project in a time-efficient and uniform manner.