Pasar al contenido principal

Resultados relacionados

Resultados totales (Incluyendo duplicados): 11
Encontrada(s) 1 página(s)

UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Challenges to enforce data quality in data spaces

  • Ayala Martínez, Claudia Patricia|||0000-0002-6262-3698
  • Bilalli, Besim|||0000-0002-0575-2389
  • Gómez Seoane, Cristina|||0000-0002-3872-0439
  • Mazon López, Jose Norberto
  • Romero Moral, Óscar|||0000-0001-6350-8328
Data Spaces must preserve sovereignty and privacy while ensuring FAIR (Findable, Accessible, Interoperable and Reusable) principles. To do so, policy-based strategies have to be developed in order to describe the agreements reached in the Data Space. In this context, two open questions arise: how to define the right Data Space policies, as well as, how to enforce (and monitor) them. Despite the efforts towards defining and enforcing data access and usage policies, there is no solution to operationalize the enforcement of those considering data quality dimensions. However, data quality is becoming a hot topic due to the surge of federated learning and alternative analytical techniques, which require all providers to guarantee a data quality threshold in order to learn robust models. Currently, we have means to describe policies related to data quality rules (e.g., by combining standards such as ODRL and standard vocabularies) but we are missing means to elicit these policies from data providers and enforce them while preserving the data sovereignty. In this paper, we discuss the challenges and open questions that must be addressed in order to operationalize (and eventually, automate) data quality in Data Spaces, which span from requirements elicitation to data validation., This work has been partially supported by the EU HORIZON program under GA.101135513 (CYCLOPS) and by CIAICO/2022/019 project from Generalitat Valenciana., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

How and why false denial constraints are discovered

  • Martín Garcia, Albert|||0009-0003-9967-9331
  • Cunha de Almeida, Eduardo
  • Romero Moral, Óscar|||0000-0001-6350-8328
  • Queralt Calafat, Anna|||0000-0003-2782-2955
Denial Constraints (DCs) are a flexible formalism to express many types of data rules, making them a widely adopted tool for many applications. This flexibility led to the development of numerous algorithms to automatically discover DCs directly from data. However, few studies have been conducted on the quality of the discovered DCs. We experimentally quantify the lack of quality in the results obtained by state-of-the-art algorithms, showing how the proportion of discovered DCs that are false is rarely below 95%. We hypothesize that the common source of these erroneous DCs stems from the adoption of the current DC validity definition. We use a statistical approach to explain the mechanism leading to these results, and propose a redefinition of DC validity properties to avoid the acceptance of false DCs. We validate this redefinition experimentally, showing that it exclusively accepts true constraints of the data, and is reliable enough to discover DCs missed by domain experts. Additionally, we provide curated sets of golden DCs for each dataset used in our study, those generated by domain experts and those discovered using our approach., This work is supported by the Horizon Europe Programme under GA.101135513 (CyclOps) and the Spanish Ministerio de Ciencia e Innovación under project PID2020-117191RB-I00 / AEI/10.13039/ 501100011033 (DOGO4ML). Anna Queralt is a Serra-Húnter fellow. E. Almeida is funded by the CNPQ grants 302909/2022-2 and 444192/2024-7. Albert Martin is funded by the predoctoral program AGAUR-FI grants (2025 FI-1 00967) Joan Oró, which is backed by the Secretariat of Universities and Research of the Department of Research and Universities of the Generalitat of Catalonia, as well as the European Social Plus Fund., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Supporting data discovery tasks at scale with FREYJA

  • Maynou Yelamos, Marc|||0009-0004-3908-4392
  • Nadal Francesch, Sergi|||0000-0002-8565-952X
Data lakes, massive repositories of heterogeneous data, were popularized by implementing a load-first model-later approach to data integration in contrast to the traditional model-first loadlater implemented in data warehouses. Yet, such settings create new challenges related to a) how to effectively discover relevant data and automatically find meaningful relationships; and b) how to do so efficiently at scale. In order to address them, we present Freyja, a data discovery system designed to navigate through vasts amounts of data and support users on finding joinable pairs of attributes. Freyja is based on the definition of a novel similarity measure, designed to automatically discovery semantically-relevant relationships. The adopted metric is tailored to data lake contexts, where datasets are denormalized and data from several domains are stored. In order to optimize and scale the computation of such metric, Freyja adopts a learning approach relying on profiles, succinct and lightweight representations of the underlying characteristics of the data attributes. Freyja leverages analytical databases to efficiently compute column profiles. In this demo, we demonstrate how Freyja, which is offered as a Python library, supports data augmentation tasks (i.e., augmenting training datasets with new features to improve the performance of a machine learning model)., This work has been partly supported by the Horizon Europe Programme under GA.101135513 (CyclOps) and the Spanish Ministerio de Ciencia e Innovación under project PID2023-152841OA-I00 / AEI/10.13039/501100011033 (TALC)., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

There is no data science without data governance: a proposal based on knowledge graphs

  • Bilalli, Besim|||0000-0002-0575-2389
  • Jovanovic, Petar|||0000-0003-4635-6646
  • Nadal Francesch, Sergi|||0000-0002-8565-952X
  • Queralt Calafat, Anna|||0000-0003-2782-2955
  • Romero Moral, Óscar|||0000-0001-6350-8328
Data Science and data-driven Artificial Intelligence are here to stay and they are expected to further transform the current global economy. From a technical point of view, there is an overall agreement that disciplines based on data require to combine data engineering and data analysis skills, but the fact is that data engineering is nowadays trailing and catching up with the rapid changes in the data analysis landscape. To unleash the real power of data, data-centric systems must be professionalized, i.e., operationalized and systematized, so that repetitive, time-consuming and error-prone tasks are automated. To such end, we propose our vision on next generation data governance for data-centric systems based on knowledge graphs. We claim that without the knowledge embedded in the data governance layer, Data Science will not unleash its potential., This work is supported by the Horizon Europe Programme under GA.101135513 (CYCLOPS) and GA. 101093164 (ExtremeXP) and the Spanish Ministerio de Ciencia e Innovación under project PID2020-117191RBI00 / AEI/10.13039/501100011033 (DOGO4ML)., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

A framework for continual knowledge graph embedding

  • Pons Recasens, Gerard|||0000-0003-2225-3255
  • Bilalli, Besim|||0000-0002-0575-2389
  • Queralt Calafat, Anna|||0000-0003-2782-2955
Knowledge Graph Embeddings (KGEs) are widely used to support downstream tasks over Knowledge Graphs (KGs) by representing entities and relations in a low-dimensional vector space. However, real-world KGs are not static, as new facts are continuously added, requiring old embeddings to be updated and new embeddings to be learned without forgetting previously acquired information. Existing KGE libraries focus on the static KG scenario. Moreover, while recent works on Continual Knowledge Graph Embedding (CKGE) propose strategies to address this problem, they rely on standalone frameworks and only support simple KGE models, such as TransE, limiting their potential. We extended the KGE library PyKEEN to enable continual learning in KGs. Our extension (i) expands any unimodal KGE model in PyKEEN with new entities and relations, (ii) introduces an informed initialization method to improve the addition of new embeddings, (iii) incorporates CKGE-oriented evaluation metrics to assess both performance and knowledge forgetting and acquisition, and (iv) offers an intuitive training function with dashboard support, enabling easy experimentation and tracking of the evolution of embeddings across updates. A repository containing the scripts, an interactive notebook tutorial, and an accompanying video are available., This work is supported by the Horizon Europe Programme under GA.101135513 (CyclOps) and the Spanish Ministerio de Ciencia e Innovación under project PID2023-152841OA-I00/AEI/10.13039/50110 0011033 (TALC)., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

HealthMesh: An architectural framework for federated healthcare data management

  • Bisquert Parés, Aniol
  • Hmimou Ham Man, Achraf|||0009-0004-0448-3406
  • Berral García, Josep Lluís|||0000-0003-3037-3580
  • Gutiérrez Torre, Alberto|||0000-0002-5548-3359
  • Romero Moral, Óscar|||0000-0001-6350-8328
Recently, significant milestones have been achieved in the field of healthcare data analysis. However, alongside these accomplishments, substantial data-related challenges have emerged in the domain of big data management. Modern healthcare projects are no more dealing with a single data repository but many heterogeneous ones and must overcome data variety, privacy and governance issues. Yet, current solutions face a privacy-decentralization trade-off. To address this dual challenge, we introduce HealthMesh, a novel layered architectural framework based on the Data Mesh principles, providing a domaindecentralised paradigm. In addition, the framework incorporates a Semantic Data Model which establishes robust governance, enables interoperability and guarantees policy compliance for all the data assets. To demonstrate the capabilities of the proposed approach, we provide an illustrative example inspired by the use case of the INCISIVE project for breast cancer analytics. Overall, this work makes a significant contribution on collecting key challenges, identifying actors and providing a set of components and guidelines for establishing a holistic framework for the complex field of healthcare data management., The work reported here was supported by the EU-H2020 programme under GA.952179 INCISIVE, Horizon Europe Programme under GA.101095717 (SECURED) and GA.101135513 (CYCLOPS), the Spanish Research State Agency (MICINN/AEI, ERDF/FEDER) under GA.MCIN/AEI/10.13039/501100011033/FEDER (UE DALEST), the Spanish Ministerio de Ciencia e Innovación under project PID2020-117191RB-I00 / AEI/10.13039/501100011033 (DOGO4ML), and the Generalitat de Catalunya (AGAUR) 2021-SGR-00478 (CROMAI)., Peer Reviewed
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

There is no data science without data governance: a proposal based on knowledge graphs

  • Bilalli, Besim
  • Jovanovic, Petar
  • Nadal Francesch, Sergi
  • Queralt Calafat, Anna
  • Romero Moral, Óscar
Data Science and data-driven Artificial Intelligence are here to stay and they are expected to further transform the current global economy. From a technical point of view, there is an overall agreement that disciplines based on data require to combine data engineering and data analysis skills, but the fact is that data engineering is nowadays trailing and catching up with the rapid changes in the data analysis landscape. To unleash the real power of data, data-centric systems must be professionalized, i.e., operationalized and systematized, so that repetitive, time-consuming and error-prone tasks are automated. To such end, we propose our vision on next generation data governance for data-centric systems based on knowledge graphs. We claim that without the knowledge embedded in the data governance layer, Data Science will not unleash its potential., This work is supported by the Horizon Europe Programme under GA.101135513 (CYCLOPS) and GA. 101093164 (ExtremeXP) and the Spanish Ministerio de Ciencia e Innovación under project PID2020-117191RBI00 / AEI/10.13039/501100011033 (DOGO4ML)., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Supporting data discovery tasks at scale with FREYJA

  • Maynou Yelamos, Marc
  • Nadal Francesch, Sergi
Data lakes, massive repositories of heterogeneous data, were popularized by implementing a load-first model-later approach to data integration in contrast to the traditional model-first loadlater implemented in data warehouses. Yet, such settings create new challenges related to a) how to effectively discover relevant data and automatically find meaningful relationships; and b) how to do so efficiently at scale. In order to address them, we present Freyja, a data discovery system designed to navigate through vasts amounts of data and support users on finding joinable pairs of attributes. Freyja is based on the definition of a novel similarity measure, designed to automatically discovery semantically-relevant relationships. The adopted metric is tailored to data lake contexts, where datasets are denormalized and data from several domains are stored. In order to optimize and scale the computation of such metric, Freyja adopts a learning approach relying on profiles, succinct and lightweight representations of the underlying characteristics of the data attributes. Freyja leverages analytical databases to efficiently compute column profiles. In this demo, we demonstrate how Freyja, which is offered as a Python library, supports data augmentation tasks (i.e., augmenting training datasets with new features to improve the performance of a machine learning model)., This work has been partly supported by the Horizon Europe Programme under GA.101135513 (CyclOps) and the Spanish Ministerio de Ciencia e Innovación under project PID2023-152841OA-I00 / AEI/10.13039/501100011033 (TALC)., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

How and why false denial constraints are discovered

  • Martín Garcia, Albert
  • Cunha de Almeida, Eduardo
  • Romero Moral, Óscar
  • Queralt Calafat, Anna
Denial Constraints (DCs) are a flexible formalism to express many types of data rules, making them a widely adopted tool for many applications. This flexibility led to the development of numerous algorithms to automatically discover DCs directly from data. However, few studies have been conducted on the quality of the discovered DCs. We experimentally quantify the lack of quality in the results obtained by state-of-the-art algorithms, showing how the proportion of discovered DCs that are false is rarely below 95%. We hypothesize that the common source of these erroneous DCs stems from the adoption of the current DC validity definition. We use a statistical approach to explain the mechanism leading to these results, and propose a redefinition of DC validity properties to avoid the acceptance of false DCs. We validate this redefinition experimentally, showing that it exclusively accepts true constraints of the data, and is reliable enough to discover DCs missed by domain experts. Additionally, we provide curated sets of golden DCs for each dataset used in our study, those generated by domain experts and those discovered using our approach., This work is supported by the Horizon Europe Programme under GA.101135513 (CyclOps) and the Spanish Ministerio de Ciencia e Innovación under project PID2020-117191RB-I00 / AEI/10.13039/ 501100011033 (DOGO4ML). Anna Queralt is a Serra-Húnter fellow. E. Almeida is funded by the CNPQ grants 302909/2022-2 and 444192/2024-7. Albert Martin is funded by the predoctoral program AGAUR-FI grants (2025 FI-1 00967) Joan Oró, which is backed by the Secretariat of Universities and Research of the Department of Research and Universities of the Generalitat of Catalonia, as well as the European Social Plus Fund., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Challenges to enforce data quality in data spaces

  • Ayala Martínez, Claudia Patricia
  • Bilalli, Besim
  • Gómez Seoane, Cristina
  • Mazon López, Jose Norberto
  • Romero Moral, Óscar
Data Spaces must preserve sovereignty and privacy while ensuring FAIR (Findable, Accessible, Interoperable and Reusable) principles. To do so, policy-based strategies have to be developed in order to describe the agreements reached in the Data Space. In this context, two open questions arise: how to define the right Data Space policies, as well as, how to enforce (and monitor) them. Despite the efforts towards defining and enforcing data access and usage policies, there is no solution to operationalize the enforcement of those considering data quality dimensions. However, data quality is becoming a hot topic due to the surge of federated learning and alternative analytical techniques, which require all providers to guarantee a data quality threshold in order to learn robust models. Currently, we have means to describe policies related to data quality rules (e.g., by combining standards such as ODRL and standard vocabularies) but we are missing means to elicit these policies from data providers and enforce them while preserving the data sovereignty. In this paper, we discuss the challenges and open questions that must be addressed in order to operationalize (and eventually, automate) data quality in Data Spaces, which span from requirements elicitation to data validation., This work has been partially supported by the EU HORIZON program under GA.101135513 (CYCLOPS) and by CIAICO/2022/019 project from Generalitat Valenciana., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

HealthMesh: An architectural framework for federated healthcare data management

  • Bisquert Parés, Aniol
  • Hmimou Ham Man, Achraf
  • Berral García, Josep Lluís
  • Gutiérrez Torre, Alberto
  • Romero Moral, Óscar
Recently, significant milestones have been achieved in the field of healthcare data analysis. However, alongside these accomplishments, substantial data-related challenges have emerged in the domain of big data management. Modern healthcare projects are no more dealing with a single data repository but many heterogeneous ones and must overcome data variety, privacy and governance issues. Yet, current solutions face a privacy-decentralization trade-off. To address this dual challenge, we introduce HealthMesh, a novel layered architectural framework based on the Data Mesh principles, providing a domaindecentralised paradigm. In addition, the framework incorporates a Semantic Data Model which establishes robust governance, enables interoperability and guarantees policy compliance for all the data assets. To demonstrate the capabilities of the proposed approach, we provide an illustrative example inspired by the use case of the INCISIVE project for breast cancer analytics. Overall, this work makes a significant contribution on collecting key challenges, identifying actors and providing a set of components and guidelines for establishing a holistic framework for the complex field of healthcare data management., The work reported here was supported by the EU-H2020 programme under GA.952179 INCISIVE, Horizon Europe Programme under GA.101095717 (SECURED) and GA.101135513 (CYCLOPS), the Spanish Research State Agency (MICINN/AEI, ERDF/FEDER) under GA.MCIN/AEI/10.13039/501100011033/FEDER (UE DALEST), the Spanish Ministerio de Ciencia e Innovación under project PID2020-117191RB-I00 / AEI/10.13039/501100011033 (DOGO4ML), and the Generalitat de Catalunya (AGAUR) 2021-SGR-00478 (CROMAI)., Peer Reviewed, Postprint (published version)