Pasar al contenido principal

Resultados relacionados

Resultados totales (Incluyendo duplicados): 8
Encontrada(s) 1 página(s)

UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

Operationalizing and automating data validation in data spaces

  • Hmimou Ham Man, Achraf|||0009-0004-0448-3406
  • Jovanovic, Petar|||0000-0003-4635-6646
  • Nadal Francesch, Sergi|||0000-0002-8565-952X
  • Romero Moral, Óscar|||0000-0001-6350-8328
  • Queralt Calafat, Anna|||0000-0003-2782-2955
Data spaces have recently emerged as an innovative paradigm for cross-organizational data sharing. These decentralized environments require sophisticated data governance protocols to ensure compliance with data standards, roles and policies. While current policy-based solutions address enforcement of data access control and usage rights, they lack mechanisms for automated data validation -essential for ensuring data quality for collaborative analytics. To address this gap, we present a knowledge graph-based framework to automate data validation inline with data policies. This framework relies on the concept of policy checkers, which represent high-level and technology-agnostic data validation plans that can be dynamically translated into technology-specific user defined functions (UDFs) for compliance checking. Importantly, the usage of knowledge graphs to describe the policy checkers enhances the transparency and traceability of data validation processes, while the two-stage process (technology-agnostic policy checkers and technology-specific UDFs) accommodate data validation on multimodal data. We accompany the description of our approach with a proof of concept that demonstrates the feasibility of this solution in real data spaces., This work has been partly supported by the Horizon Europe Programme under GA.101135513 (CyclOps) and the Spanish Ministerio de Ciencia e Innovación under project PID2023-152841OA-I00/ AEI/10.13039/501100011033 (TALC)., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

Reprogramming heritage: an approach for the automatization in the adaptative reuse of buildings

  • Domènech Rodríguez, Marta|||0000-0002-6152-679X
  • López López, David|||0000-0002-3544-618X
  • Nadal Francesch, Sergi|||0000-0002-8565-952X
  • Queralt Calafat, Anna|||0000-0003-2782-2955
  • Cornadó Bardón, Còssima|||0000-0003-0553-7176
This article introduces a methodology for a novel data-driven computational model aimed at aiding public administrations in managing and evaluating the adaptative reuse of buildings while tackling ecological and digital challenges. Drawing from the 2030 Agenda for Sustainable Development, the study underscores the significance of innovative approaches in harnessing the economic potential of data. Focusing on Barcelona’s Ciutat Vella district, the research selects five historic public buildings for analysis, strategically positioned to spur local entrepreneurship and counteract tourism dominance. Through an extensive literature review, the article identifies a gap in computational models for building adaptative reuse and proposes a methodological framework that integrates data collection, processing, and computational modelling, underscored by GIS technology and open data sources. The proposed methodology for a computational algorithm aims to systematise spatial characteristics, assess programmatic needs, and optimise building usage, while addressing challenges such as data integration and quality assurance. Ultimately, the research presents a pioneering approach to building adaptative reuse, aimed at fostering sustainable urban development and offering replicable insights applicable to similar challenges in other cities., Cohabitem Barcelona: cinc casos d’estudi a Ciutat Vella per a la reutilització urbana i el foment de models productius innovadors, Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

Enhancing data discovery with contextual pre-filtering

  • Flores Herrera, Javier de Jesús|||0000-0002-2998-9962
  • Nadal Francesch, Sergi|||0000-0002-8565-952X
  • Romero Moral, Óscar|||0000-0001-6350-8328
In this paper, entity contextual pre-filtering is proposed to refine dataset relevance assessment and streamline data discovery. Heterogeneous Graph Neural Networks are used to exploit the local context embedded within graph-based schemas. The proposed pre-filtering approach is versatile and does not rely on any specific similarity metric, making it applicable to a wide range of data discovery methods. The proposed technique increases data discovery precision by reducing false positives and identifying significant data relationships. This method has been empirically validated across a variety of real-world datasets to improve data discovery efficiency and accuracy., This work has been partly supported by the Horizon Europe Programme under GA.101135513 (CyclOps) and the Spanish Ministerio de Ciencia e Innovación under project PID2023-152841OA-I00 / AEI / 10.13039/501100011033 (TALC)., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

Freyja: Efficient join discovery in data lakes

  • Maynou Yelamos, Marc|||0009-0004-3908-4392
  • Nadal Francesch, Sergi|||0000-0002-8565-952X
  • Panadero Palenzuela, Raquel
  • Flores Herrera, Javier de Jesús|||0000-0002-2998-9962
  • Romero Moral, Óscar|||0000-0001-6350-8328
  • Queralt Calafat, Anna|||0000-0003-2782-2955
We study the problem of efficiently computing rankings of joinable attributes in data lakes. Traditional set-overlap measures produce numerous false positives in this scenario, while modern, more accurate Table Representation Learning (TRL) techniques incur prohibitive computational costs. In contrast to the state-of-the-art, we adopt a novel notion of join quality tailored to data lakes relying on a metric that combines multiset Jaccard and cardinality proportion. The proposed metric merges the best of both worlds by leveraging syntactic measures while achieving accuracy scores comparable to those of TRL approaches. Generating rankings of joinable pairs is highly scalable at both preparation and query time, since we train a general-purpose predictive model. Predictions are based on data profiles, succinct and efficiently computed representations of dataset characteristics. Our experiments show that our system, Freyja, matches and improves upon, the results obtained by the state-of-the-art while reducing execution costs by orders of magnitude., This work has been partly supported by the Horizon Europe Programme under GA.101135513 (CyclOps) and the Spanish Ministerio de Ciencia e Innovacion under project PID2023-152841OA-I00 / AEI/10.13039/501100011033 (TALC). Anna Queralt is a Serra Hunter Fellow., Peer Reviewed
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Freyja: Efficient join discovery in data lakes

  • Maynou Yelamos, Marc
  • Nadal Francesch, Sergi
  • Panadero Palenzuela, Raquel
  • Flores Herrera, Javier de Jesús
  • Romero Moral, Óscar
  • Queralt Calafat, Anna
We study the problem of efficiently computing rankings of joinable attributes in data lakes. Traditional set-overlap measures produce numerous false positives in this scenario, while modern, more accurate Table Representation Learning (TRL) techniques incur prohibitive computational costs. In contrast to the state-of-the-art, we adopt a novel notion of join quality tailored to data lakes relying on a metric that combines multiset Jaccard and cardinality proportion. The proposed metric merges the best of both worlds by leveraging syntactic measures while achieving accuracy scores comparable to those of TRL approaches. Generating rankings of joinable pairs is highly scalable at both preparation and query time, since we train a general-purpose predictive model. Predictions are based on data profiles, succinct and efficiently computed representations of dataset characteristics. Our experiments show that our system, Freyja, matches and improves upon, the results obtained by the state-of-the-art while reducing execution costs by orders of magnitude., This work has been partly supported by the Horizon Europe Programme under GA.101135513 (CyclOps) and the Spanish Ministerio de Ciencia e Innovacion under project PID2023-152841OA-I00 / AEI/10.13039/501100011033 (TALC). Anna Queralt is a Serra Hunter Fellow., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Operationalizing and automating data validation in data spaces

  • Hmimou Ham Man, Achraf
  • Jovanovic, Petar
  • Nadal Francesch, Sergi
  • Romero Moral, Óscar
  • Queralt Calafat, Anna
Data spaces have recently emerged as an innovative paradigm for cross-organizational data sharing. These decentralized environments require sophisticated data governance protocols to ensure compliance with data standards, roles and policies. While current policy-based solutions address enforcement of data access control and usage rights, they lack mechanisms for automated data validation -essential for ensuring data quality for collaborative analytics. To address this gap, we present a knowledge graph-based framework to automate data validation inline with data policies. This framework relies on the concept of policy checkers, which represent high-level and technology-agnostic data validation plans that can be dynamically translated into technology-specific user defined functions (UDFs) for compliance checking. Importantly, the usage of knowledge graphs to describe the policy checkers enhances the transparency and traceability of data validation processes, while the two-stage process (technology-agnostic policy checkers and technology-specific UDFs) accommodate data validation on multimodal data. We accompany the description of our approach with a proof of concept that demonstrates the feasibility of this solution in real data spaces., This work has been partly supported by the Horizon Europe Programme under GA.101135513 (CyclOps) and the Spanish Ministerio de Ciencia e Innovación under project PID2023-152841OA-I00/ AEI/10.13039/501100011033 (TALC)., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Enhancing data discovery with contextual pre-filtering

  • Flores Herrera, Javier de Jesús
  • Nadal Francesch, Sergi
  • Romero Moral, Óscar
In this paper, entity contextual pre-filtering is proposed to refine dataset relevance assessment and streamline data discovery. Heterogeneous Graph Neural Networks are used to exploit the local context embedded within graph-based schemas. The proposed pre-filtering approach is versatile and does not rely on any specific similarity metric, making it applicable to a wide range of data discovery methods. The proposed technique increases data discovery precision by reducing false positives and identifying significant data relationships. This method has been empirically validated across a variety of real-world datasets to improve data discovery efficiency and accuracy., This work has been partly supported by the Horizon Europe Programme under GA.101135513 (CyclOps) and the Spanish Ministerio de Ciencia e Innovación under project PID2023-152841OA-I00 / AEI / 10.13039/501100011033 (TALC)., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Reprogramming heritage: an approach for the automatization in the adaptative reuse of buildings

  • Domènech Rodríguez, Marta
  • López López, David
  • Nadal Francesch, Sergi
  • Queralt Calafat, Anna
  • Cornadó Bardón, Còssima
This article introduces a methodology for a novel data-driven computational model aimed at aiding public administrations in managing and evaluating the adaptative reuse of buildings while tackling ecological and digital challenges. Drawing from the 2030 Agenda for Sustainable Development, the study underscores the significance of innovative approaches in harnessing the economic potential of data. Focusing on Barcelona’s Ciutat Vella district, the research selects five historic public buildings for analysis, strategically positioned to spur local entrepreneurship and counteract tourism dominance. Through an extensive literature review, the article identifies a gap in computational models for building adaptative reuse and proposes a methodological framework that integrates data collection, processing, and computational modelling, underscored by GIS technology and open data sources. The proposed methodology for a computational algorithm aims to systematise spatial characteristics, assess programmatic needs, and optimise building usage, while addressing challenges such as data integration and quality assurance. Ultimately, the research presents a pioneering approach to building adaptative reuse, aimed at fostering sustainable urban development and offering replicable insights applicable to similar challenges in other cities., Cohabitem Barcelona: cinc casos d’estudi a Ciutat Vella per a la reutilització urbana i el foment de models productius innovadors, Peer Reviewed, Postprint (published version)