Skip to main content

Resultados relacionados

Resultados totales (Incluyendo duplicados): 6
Encontrada(s) 1 página(s)

RUA. Repositorio Institucional de la Universidad de Alicante
Publication Otros (Other)

Privacy and Accuracy Implications of Model Complexity and Integration in Heterogeneous Federated Learning

  • Németh, Gergely Dániel
  • Lozano, Miguel Angel
  • Quadrianto, Novi
  • Oliver, Nuria
  • Lozano, Miguel Angel|||/items/413f111d-7a63-43f2-bb70-6421affe1647
Federated Learning (FL) has been proposed as a privacy-preserving solution for distributed machine learning, particularly in heterogeneous FL settings where clients have varying computational capabilities and thus train models with different complexities compared to the server’s model. However, FL is not without vulnerabilities: recent studies have shown that it is susceptible to membership inference attacks (MIA), which can compromise the privacy of client data. In this paper, we examine the intersection of these two aspects, heterogeneous FL and its privacy vulnerabilities, by focusing on the role of client model integration, the process through which the server integrates parameters from clients’ smaller models into its larger model. To better understand this process, we first propose a taxonomy that categorizes existing heterogeneous FL methods and enables the design of seven novel heterogeneous FL model integration strategies. Using CIFAR-10, CIFAR-100, and FEMNIST vision datasets, we evaluate the privacy and accuracy trade-offs of these approaches under three types of MIAs. Our findings reveal significant differences in privacy leakage and performance depending on the integration method. Notably, introducing randomness in the model integration process enhances client privacy while maintaining competitive accuracy for both the clients and the server. This work provides quantitative light on the privacy-accuracy implications client model integration in heterogeneous FL settings, paving the way towards more secure and efficient FL systems.
RUA. Repositorio Institucional de la Universidad de Alicante
Publication Otros (Other)

Relaxing Core Assumptions: the Impact of Data, Model and Participation Heterogeneity on Performance, Privacy and Fairness in Federated Learning

  • Németh, Gergely Dániel
Federated Learning (FL) enables decentralized training of machine learning models on distributed data while preserving privacy by design. An FL design consists of clients training models on private data and a central server aggregating a global model based on the consensus among clients. In an ideal scenario, the training data and computing resources are identically and independently distributed (i.i.d.) among clients, therefore, clients can work together in agreement to reach a global optima. However, in realistic FL settings, heterogeneity arises between clients in terms of both data and resource availability. This research focuses on such scenarios, with a special interest on how the server can adapt the aggregation method from a simple averaging to address the clients’ diversity. The first research direction discusses existing client selection methods and proposes a novel taxonomy of FL methods where the participation of the clients is actively managed by the server to achieve a global objective with respect to the client heterogeneity. This research direction is presented in [NLQO22]. The next chapter focuses on model heterogeneity as an inclusion policy for low-resource clients. It investigates the implications of client resource constraints on privacy given a reduced model complexity in low-resource clients. This work has been presented in [NLQO25]. The final area provides a solution to the data heterogeneity problem with distribution aware client selection. Applying this solution can mitigate spurious correlations and improve algorithmic fairness in FL. This research line has been described in [NFN+25]. [NLQO22] Németh, G. D., Lozano, M. A., Quadrianto, N., and Oliver, N. (2022). A Snapshot of the Frontiers of Client Selection in Federated Learning. Transactions on Machine Learning Research. [NLQO25] Németh, G. D., Lozano, M. A., Quadrianto, N., and Oliver, N. (2025). Privacy and Accuracy Implications of Model Complexity and Integration in Heterogeneous Federated Learning. IEEE Access, 13, 40258-40274. [NFN+25] Németh, G. D., Fani, E., Ng, Y. J., Caputo, B., Lozano, M. A., Oliver, N., and Quadrianto, N.(2025). FedDiverse: Tackling Data Heterogeneity in Federated Learning with Diversity-Driven Client Selection.
RUA. Repositorio Institucional de la Universidad de Alicante
Publication Otros (Other)

A Snapshot of the Frontiers of Client Selection in Federated Learning

  • Németh, Gergely Dániel
  • Lozano, Miguel Angel
  • Quadrianto, Novi
  • Oliver, Nuria
  • Lozano, Miguel Angel|||/items/413f111d-7a63-43f2-bb70-6421affe1647
Federated learning (FL) has been proposed as a privacy-preserving approach in distributed machine learning. A federated learning architecture consists of a central server and a number of clients that have access to private, potentially sensitive data. Clients are able to keep their data in their local machines and only share their locally trained model’s parameters with a central server that manages the collaborative learning process. FL has delivered promising results in real-life scenarios, such as healthcare, energy, and finance. However, when the number of participating clients is large, the overhead of managing the clients slows down the learning. Thus, client selection has been introduced as an approach to limit the number of communicating parties at every step of the process. Since the early naïve random selection of clients, several client selection methods have been proposed in the literature. Unfortunately, given that this is an emergent field, there is a lack of a taxonomy of client selection methods, making it hard to compare approaches. In this paper, we propose a taxonomy of client selection in Federated Learning that enables us to shed light on current progress in the field and identify potential areas of future research in this promising area of machine learning.
BIRD. BCAM's Institutional Repository Data
Publication Artículo científico (JournalArticle)

Preserving the Fairness Guarantees of Classifiers in Changing Environments: a Survey

BIRD. BCAM's Institutional Repository Data
Publication Artículo científico (JournalArticle)

A First Rigorous Attempt to Explain Charge Transport in a Protein-Ligand complex

  • Dempsey, R.M.
  • Uria-Albizuri, J.
  • Bru, J.-B.
  • Rodrigues, J.
Recent experimental evidence shows that when a protein (or peptide) binds to its ligand pair, the protein effectively “switches on” enabling long-range charge transport within the protein. Astonishingly, the protein-ligand complex exhibits conductances in the order of nanosiemens over distances of many nanometers and macroscopic Ohm’s law emerges. Here, we investigate this emergent phenomenon via the framework of many-body (fermionic) quantum statistical principles. We propose a simple model which gives rise to an Ohm’s law with vanishing quantum effects in its thermodynamic limit (with respect to length scales). Specifically, we consider protein-ligand complexes as a two-band 1D lattice Hamiltonian system in which charge carriers (electrons or holes) are assumed to be quasi-free. We investigate theoretically and numerically the behavior of the microscopic current densities with respect to varying voltage, temperature and length within reasonable physiological parameter ranges. We compute the current observable at each site of the protein-ligand lattice and demonstrate how the local microscopic charge transport behavior generates the macroscopic current. The overall framework contributes to the search for unifying principles for long-range charge transport and associated emergent laws in protein complexes, which is crucial for bioelectronics., Project of Basque Government through the grant IT1615-22.Ikerbasque (The Basque Foundation for Science), BCAM Severo Ochoa accreditation CEX2021-001142-S / MICIN / AEI / 10.13039/501100011033, grant RTI2018-093860-B-C21 funded by (AEI/FEDER, UE) and acronym “MathNEURO”. COST Action CA18232 financed by the European Cooperation in Science and Technology (COST). Project PID2020-112948GB-I00 funded by MCIN/AEI/10.13039/501100011033 and by "ERDF A way of making Europe". Project PID2020-117281GB-I00 and PID2019-107444GA-I00, partly from European Regional Development Fund (ERDF), and the Basque Government, grant IT1483-22.
Academica-e. Repositorio Institucional de la Universidad Pública de Navarra
Publication Artículo científico (JournalArticle)

Preserving the fairness guarantees of classifiers in changing environments: a survey

  • Barrainkua, Ainhize
  • Gordaliza Pastor, Paula
  • Lozano, José Antonio
  • Quadrianto, Novi
The impact of automated decision-making systems on human lives is growing, emphasizing the need for these systems to be not only accurate but also fair. The ield of algorithmic fairness has expanded signiicantly in the past decade, with most approaches assuming that training and testing data are drawn independently and identically from the same distribution. However, in practice, diferences between the training and deployment environments exist, compromising both the performance and fairness of the decision-making algorithms in real-world scenarios. A new area of research has emerged to address how to maintain fairness guarantees in classiication tasks when the data generation processes difer between the source (training) and target (testing) domains. The objective of this survey is to ofer a comprehensive examination of fair classiication under distribution shift by presenting a taxonomy of current approaches. The latter is formulated based on the available information from the target domain, distinguishing between adaptive methods, which adapt to the target environment based on available information, and robust methods, which make minimal assumptions about the target environment. Additionally, this study emphasizes alternative benchmarking methods, investigates the interconnection with related research ields, and identiies potential avenues for future research., This research was supported by a European Research Council (ERC) Starting Grant for the project “Bayesian Models and Algorithms for Fairness and Transparencyž, funded under the European Union’s Horizon 2020 Framework Programme (grant agreement no. 851538); by the Basque Government under grant IT1504-22 and through the BERC 2022-2025 program; by the Spanish Ministry of Science and Innovation under the grants PID2022-137442NB-I00 and PID2021-128314NB-I00, and through BCAM Severo Ochoa accreditation CEX2021-001142-S MICIN/AEI/10.13039/501100011033.