Skip to main content

Resultados relacionados

Resultados totales (Incluyendo duplicados): 4
Encontrada(s) 1 página(s)

UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Towards specification of a software architecture for cross-sectoral big data applications

  • Arapakis, Ioannis
  • Becerra Fontal, Yolanda|||0000-0003-2357-7796
  • Boehm, Omer
  • Bravos, Geroge
  • Chatzigiannakis, Vassilis
  • Cugnasco, Cesare
  • Demetriou, Giorgos
  • Eleftheriou, Iliada
  • Mascolo, Julien Etienne
  • Fodor, Lidija
  • Ioannidis, Sotiris
  • Jakovetic, Dusan
  • Kallipolitis, Leonidas
  • Kavakli, Evangelia
  • Kopanaki, Despina
  • Kourtellis, Nicolas
  • Marcos, Mario Maawad
  • Martin de Pozuelo, Ramon
  • Milosevic, Nemanja
  • Morandi, Giuditta
  • Pages Montanera, Enric
  • Ristow, Gerald
  • Sakellariou, Rizos
  • Sirvent, Raül
  • Skrbic, Srdjan
  • Spais, Ilias
  • Vasiliadis, Giorgos
  • Vinov, Michael
The proliferation of Big Data applications puts pressure on improving and optimizing the handling of diverse datasets across different domains. Among several challenges, major difficulties arise in data-sensitive domains like banking, telecommunications, etc., where strict regulations make very difficult to upload and experiment with real data on external cloud resources. In addition, most Big Data research and development efforts aim to address the needs of IT experts, while Big Data analytics tools remain unavailable to non-expert users to a large extent. In this paper, we report on the work-in-progress carried out in the context of the H2020 project I-BiDaaS (Industrial-Driven Big Data as a Self-service Solution) which aims to address the above challenges. The project will design and develop a novel architecture stack that can be easily configured and adjusted to address cross-sectoral needs, helping to resolve data privacy barriers in sensitive domains, and at the same time being usable by non-experts. This paper discusses and motivates the need for Big Data as a self-service, reviews the relevant literature, and identifies gaps with respect to the challenges described above. We then present the I-BiDaaS paradigm for Big Data as a self-service, position it in the context of existing references, and report on initial work towards the conceptual specification of the I-BiDaaS software architecture., This work is supported by the IBiDaaS project, funded by the European Commission under Grant Agreement No. 780787., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

The OTree: multidimensional indexing with efficient data sampling for HPC

  • Cugnasco, Cesare
  • Calmet, Hadrien|||0000-0001-5443-761X
  • Santamaria Mateu, Pol
  • Sirvent Pardell, Raül|||0000-0003-0606-2512
  • Eguzkitza, Ane Beatriz
  • Houzeaux, Guillaume|||0000-0002-2592-1426
  • Becerra Fontal, Yolanda|||0000-0003-2357-7796
  • Torres Viñals, Jordi|||0000-0003-1963-7418
  • Labarta Mancho, Jesús José|||0000-0002-7489-4727
Spatial big data is considered an essential trend in future scientific and business applications. Indeed, research instruments, medical devices, and social networks generate hundreds of petabytes of spatial data per year. However, many authors have pointed out that the lack of specialized frameworks for multidimensional Big Data is limiting possible applications and precluding many scientific breakthroughs. Paramount in achieving High-Performance Data Analytics is to optimize and reduce the I/O operations required to analyze large data sets. To do so, we need to organize and index the data according to its multidimensional attributes. At the same time, to enable fast and interactive exploratory analysis, it is vital to generate approximate representations of large datasets efficiently. In this paper, we propose the Outlook Tree (or OTree), a novel Multidimensional Indexing with efficient data Sampling (MIS) algorithm. The OTree enables exploratory analysis of large multidimensional datasets with arbitrary precision, a vital missing feature in current distributed data management solutions. Our algorithm reduces the indexing overhead and achieves high performance even for write-intensive HPC applications. Indeed, we use the OTree to store the scientific results of a study on the efficiency of drug inhalers. Then we compare the OTree implementation on Apache Cassandra, named Qbeast, with PostgreSQL and plain storage. Lastly, we demonstrate that our proposal delivers better performance and scalability., Peer Reviewed
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

The OTree: multidimensional indexing with efficient data sampling for HPC

  • Cugnasco, Cesare
  • Calmet, Hadrien
  • Santamaria Mateu, Pol
  • Sirvent Pardell, Raül
  • Eguzkitza, Ane Beatriz
  • Houzeaux, Guillaume
  • Becerra Fontal, Yolanda
  • Torres Viñals, Jordi
  • Labarta Mancho, Jesús José
Spatial big data is considered an essential trend in future scientific and business applications. Indeed, research instruments, medical devices, and social networks generate hundreds of petabytes of spatial data per year. However, many authors have pointed out that the lack of specialized frameworks for multidimensional Big Data is limiting possible applications and precluding many scientific breakthroughs. Paramount in achieving High-Performance Data Analytics is to optimize and reduce the I/O operations required to analyze large data sets. To do so, we need to organize and index the data according to its multidimensional attributes. At the same time, to enable fast and interactive exploratory analysis, it is vital to generate approximate representations of large datasets efficiently. In this paper, we propose the Outlook Tree (or OTree), a novel Multidimensional Indexing with efficient data Sampling (MIS) algorithm. The OTree enables exploratory analysis of large multidimensional datasets with arbitrary precision, a vital missing feature in current distributed data management solutions. Our algorithm reduces the indexing overhead and achieves high performance even for write-intensive HPC applications. Indeed, we use the OTree to store the scientific results of a study on the efficiency of drug inhalers. Then we compare the OTree implementation on Apache Cassandra, named Qbeast, with PostgreSQL and plain storage. Lastly, we demonstrate that our proposal delivers better performance and scalability., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Towards specification of a software architecture for cross-sectoral big data applications

  • Arapakis, Ioannis
  • Becerra Fontal, Yolanda
  • Boehm, Omer
  • Bravos, Geroge
  • Chatzigiannakis, Vassilis
  • Cugnasco, Cesare
  • Demetriou, Giorgos
  • Eleftheriou, Iliada
  • Mascolo, Julien Etienne
  • Fodor, Lidija
  • Ioannidis, Sotiris
  • Jakovetic, Dusan
  • Kallipolitis, Leonidas
  • Kavakli, Evangelia
  • Kopanaki, Despina
  • Kourtellis, Nicolas
  • Marcos, Mario Maawad
  • Martin de Pozuelo, Ramon
  • Milosevic, Nemanja
  • Morandi, Giuditta
  • Pages Montanera, Enric
  • Ristow, Gerald
  • Sakellariou, Rizos
  • Sirvent, Raül
  • Skrbic, Srdjan
  • Spais, Ilias
  • Vasiliadis, Giorgos
  • Vinov, Michael
The proliferation of Big Data applications puts pressure on improving and optimizing the handling of diverse datasets across different domains. Among several challenges, major difficulties arise in data-sensitive domains like banking, telecommunications, etc., where strict regulations make very difficult to upload and experiment with real data on external cloud resources. In addition, most Big Data research and development efforts aim to address the needs of IT experts, while Big Data analytics tools remain unavailable to non-expert users to a large extent. In this paper, we report on the work-in-progress carried out in the context of the H2020 project I-BiDaaS (Industrial-Driven Big Data as a Self-service Solution) which aims to address the above challenges. The project will design and develop a novel architecture stack that can be easily configured and adjusted to address cross-sectoral needs, helping to resolve data privacy barriers in sensitive domains, and at the same time being usable by non-experts. This paper discusses and motivates the need for Big Data as a self-service, reviews the relevant literature, and identifies gaps with respect to the challenges described above. We then present the I-BiDaaS paradigm for Big Data as a self-service, position it in the context of existing references, and report on initial work towards the conceptual specification of the I-BiDaaS software architecture., This work is supported by the IBiDaaS project, funded by the European Commission under Grant Agreement No. 780787., Peer Reviewed, Postprint (author's final draft)