Pasar al contenido principal

Resultados relacionados

Resultados totales (Incluyendo duplicados): 10
Encontrada(s) 1 página(s)

DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Effective theory of collective deep learning

  • Arola-Fernández, Lluís
  • Lacasa, Lucas
Unraveling the emergence of collective learning in systems of coupled artificial neural networks points to broader implications for physics, machine learning, neuroscience, and society. Here we introduce a minimal model of interacting deep neural nets that condenses several recent decentralized algorithms by considering a competition between two terms: the local learning dynamics in the parameters of each neural network unit, and a diffusive coupling among units that tends to homogenize the parameters of the ensemble. We derive an effective theory for linear networks to show that the coarse-grained behavior of our system is equivalent to a deformed Ginzburg-Landau model with quenched disorder. This framework predicts depth-dependent disorder-order-disorder phase transitions in the parameters' solutions that reveal a depth-delayed onset of a collective learning phase and a low-rank microscopic learning path. We validate the theory in coupled ensembles of realistic neural networks trained on MNIST and CIFAR-10 datasets under privacy constraints. Interestingly, experiments confirm that individual networks-trained on private data-can fully generalize to unseen data classes when the collective learning phase emerges. Our work elucidates the physics of collective learning and contributes to the mechanistic interpretability of deep learning in decentralized settings., This work has been funded by the Spanish State Research Agency, through projects DYNDEEP, MISLAND and a María de Maeztu project (EUR2021- 122007, PID2020-114324GB-C22 and CEX2021-001164-M, respectively), funded by the MICIU/AEI/10.13039/501100011033. The authors also acknowledge the support from the European Commission Chips Joint Undertaking Project No. 101194363 (NEHIL)., With funding from the Spanish government through the "Severo Ochoa Centre of Excellence" accreditation (CEX2021-001164-M)., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Transfer learning-enhanced deep reinforcement learning for aerodynamic airfoil optimization subject to structural constraints

  • Ramos, David
  • Lacasa, Lucas
  • Valero, Eusebio
  • Rubio, Gonzalo
© 2025 Author(s). Published under an exclusive license by AIP Publishing., The main objective of this paper is to introduce a transfer learning-enhanced deep reinforcement learning (DRL) methodology that is able to optimize the geometry of any airfoil based on concomitant aerodynamic and structural integrity criteria. To showcase the method, we aim to maximize the lift-to-drag ratio C L / C D while preserving the structural integrity of the airfoil—as modeled by its maximum thickness—and train the DRL agent using a list of different transfer learning (TL) strategies. The performance of the DRL agent is compared with Particle Swarm Optimization (PSO), a traditional gradient-free optimization method. Results indicate that DRL agents are able to perform purely aerodynamic and hybrid aerodynamic/structural shape optimization that the DRL approach outperforms PSO in terms of computational efficiency and aerodynamic improvement and that the TL-enhanced DRL agent achieves performance comparable to the DRL one, while further saving substantial computational resources., The authors thank useful discussions within the NUMATH group. D.R., E.V., and G.R. acknowledge funding from Project TIFON (No. PLEC2023-010251) funded by MCIN/AEI/10.13039/501100011033, Spain, funding from the European Union (Project HERFUSE) under GA No. 101140567. Views and opinions expressed are those of the authors only and do not necessarily reflect those of the European Union or Clean Aviation Joint Undertaking. Neither the European Union nor Clean Aviation JU can be held responsible for them. L.L. acknowledges partial financial support from via Project MISLAND (No. PID2020-114324GB-C22), CSxAI (PID2024-157526NB-I00) and the Maria de Maeztu Program for units of Excellence (Grant No. CEX2021-001164-M), the three of them funded by MICIU/AEI/10.13039/501100011033, and funding from the European Commission Chips Joint Undertaking Project No. 101194363 (NEHIL). G.R. acknowledges partial financial support received by the Grant DeepCFD (Project No. PID2022-137899OB-I00) funded by MICIU/AEI/10.13039/501100011033 and by ERDF, EU. Finally, all authors gratefully acknowledge the Universidad Politécnica de Madrid (www.upm.es) for providing computing resources on Magerit Supercomputer., With funding from the Spanish government through the "María de Maeztu Unit of Excellence" accreditation (CEX2021-001164-M), Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

A Certifiable Machine Learning-Based Pipeline to Predict Fatigue Life of Aircraft Structures

  • Ladrón, Ángel
  • Sánchez-Domínguez, Miguel
  • Rozalén, Javier
  • Sánchez, Fernando R.
  • Vicente, Javier de
  • Lacasa, Lucas
  • Valero, Eusebio
  • Rubio, Gonzalo
Fatigue life prediction is essential in both the design and operational phases of any aircraft, and in this sense safety in the aerospace industry requires early detection of fatigue cracks to prevent in-flight failures. Robust and precise fatigue life predictors are thus essential to ensure safety. Traditional engineering methods, while reliable, are time consuming and involve complex workflows, including steps such as conducting several Finite Element Method (FEM) simulations, deriving the expected loading spectrum, and applying cycle counting techniques like peak-valley or rainflow counting. These steps often require collaboration between multiple teams and tools, added to the computational time and effort required to achieve fatigue life predictions. Machine learning (ML) offers a promising complement to traditional fatigue life estimation methods, enabling faster iterations and generalization, providing quick estimates that guide decisions alongside conventional simulations. In this paper, we present a ML-based pipeline that aims to estimate the fatigue life of different aircraft wing locations given the flight parameters of the different missions that the aircraft will be operating throughout its operational life. We validate the pipeline in a realistic use case of fatigue life estimation, yielding accurate predictions alongside a thorough statistical validation and uncertainty quantification. Our pipeline constitutes a complement to traditional methodologies by reducing the amount of costly simulations and, thereby, lowering the required computational and human resources., The authors acknowledge funding from project TIFON (PLEC2023-010251) funded by MCIN/AEI/10.13039/501100011033, Spain. LL acknowledges partial support from projects MISLAND (PID2020-114324GB-C22), project CSxAI (PID2024-157526NB-I00) funded by MICIU/AEI/10.13039/501100011033/FEDER, UE, project MdM Seal of Excellence (CEX2021-001164-M) funded by MICIU/AEI/10.13039/501100011033 and from the European Commission Chips Joint Undertaking project No. 101194363 (NEHIL)., With funding from the Spanish government through the "Maria de Maeztu Centre of Excellence" accreditation (CEX2021-001164-M)., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Otros (Other)

A Certifiable Machine Learning-Based Pipeline to Predict Fatigue Life of Aircraft Structures

  • Ladrón, Ángel
  • Sánchez-Domínguez, Miguel
  • Rozalén, Javier
  • Sánchez, Fernando R.
  • Vicente, Javier de
  • Lacasa, Lucas
  • Valero, Eusebio
  • Rubio, Gonzalo
34 pages, 17 figures., Fatigue life prediction is essential in both the design and operational phases of any aircraft, and in this sense safety in the aerospace industry requires early detection of fatigue cracks to prevent in-flight failures. Robust and precise fatigue life predictors are thus essential to ensure safety. Traditional engineering methods, while reliable, are time consuming and involve complex workflows, including steps such as conducting several Finite Element Method (FEM) simulations, deriving the expected loading spectrum, and applying cycle counting techniques like peak-valley or rainflow counting. These steps often require collaboration between multiple teams and tools, added to the computational time and effort required to achieve fatigue life predictions. Machine learning (ML) offers a promising complement to traditional fatigue life estimation methods, enabling faster iterations and generalization, providing quick estimates that guide decisions alongside conventional simulations. In this paper, we present a ML-based pipeline that aims to estimate the fatigue life of different aircraft wing locations given the flight parameters of the different missions that the aircraft will be operating throughout its operational life. We validate the pipeline in a realistic use case of fatigue life estimation, yielding accurate predictions alongside a thorough statistical validation and uncertainty quantification. Our pipeline constitutes a complement to traditional methodologies by reducing the amount of costly simulations and, thereby, lowering the required computational and human resources., The authors acknowledge funding from project TIFON (PLEC2023-010251) funded by MCIN/AEI/10.13039/501100011033, Spain. LL acknowledges partial support from projects MISLAND (PID2020-114324GB-C22), project CSxAI (PID2024-157526NB-I00) funded by MICIU/AEI/10.13039/501100011033/FEDER, UE, project MdM Seal of Excellence (CEX2021-001164-M) funded by MICIU/AEI/10.13039/501100011033 and from the European Commission Chips Joint Undertaking project No. 101194363 (NEHIL)., With funding from the Spanish government through the "Maria de Maeztu Centre of Excellence" accreditation (CEX2021-001164-M)., No
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Hardware friendly deep reservoir computing

  • Gallicchio, Claudio
  • Soriano, Miguel C.
Reservoir Computing (RC) is a popular approach for modeling dynamical Recurrent Neural Networks, featured by a fixed (i.e., untrained) recurrent reservoir layer. In this paper, we introduce a novel design strategy for deep RC neural networks that is especially suitable to neuromorphic hardware implementations. From the topological perspective, the introduced model presents a multi-level architecture with ring reservoir topology and one-to-one inter-reservoir connections. The proposed design also considers hardware-friendly nonlinearity and noise modeling in the reservoir update equations. We demonstrate the introduced hardware-friendly deep RC architecture in electronic hardware, showing the promising processing capabilities on learning tasks that require both nonlinear computation and short-term memory. Additionally, we validate the effectiveness of the introduced approach on several time-series classification tasks, showing its competitive performance compared to its shallow counterpart, conventional, as well as more recent RC systems. These results emphasize the advantages of the proposed deep architecture for both practical hardware-friendly environments and broader machine learning applications., This work is partially supported by the European innovation Council project No. 101070918 (EMERGE), the European Union (EU) ChipsJU project No. 101194363 (NEHIL), by the Spanish State Research Agency, through the Severo Ochoa and María de Maeztu Program for Centers and Units of Excellence in R&D (CEX2021-001164-M), the INFOLANET project (PID2022-139409NB-I00) funded by the MICIU/AEI/10.13039/501100011033, and by NEURONE, a project funded by the European Union - Next Generation EU, M4C1 CUP I53D23003600006, under program PRIN 2022 (prj. code 20229JRTZA)., With funding from the Spanish government through the "Maria de Maeztu Centre of Excellence" accreditation (CEX2021-001164-M)., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Leveraging chaotic transients in the training of artificial neural networks

  • Jiménez-González, Pedro
  • Soriano, Miguel C.
  • Lacasa, Lucas
Traditional algorithms to optimize artificial neural networks when confronted with a supervised learning task are usually exploitation-type relaxational dynamics such as gradient descent (GD). Here, we explore the dynamics of the neural network trajectory along training for unconventionally large learning rates. We show that for a region of values of the learning rate, the GD optimization shifts away from purely exploitationlike algorithm into a regime of exploration-exploitation balance, as the neural network is still capable of learning but the trajectory shows sensitive dependence on initial conditions—as characterized by positive network maximum Lyapunov exponent. Interestingly, the characteristic training time required to reach an acceptable accuracy in the test set reaches a minimum precisely in such learning rate region, further suggesting that one can accelerate the training of artificial neural networks by locating at the onset of chaos. Our results—initially illustrated for the MNIST classification task—qualitatively hold for a range of supervised learning tasks, learning architectures (including both shallow and deep multilayer perceptrons and convolutional neural networks) and other hyperparameters (different activation functions and weight regularization), and showcase the emergent, constructive role of transient chaotic dynamics in the training of artificial neural networks., P.J. acknowledges funding from Maria de Maeztu (MdM) Seal of Excellence (CEX2021-001164-M) via the FPI programme (Grant No. PRE2022-104148), funded by the MICIU/AEI/10.13039/501100011033. L.L. acknowledges partial support from project CSxAI (PID2024-157526NB-I00) funded by MICIU/AEI/10.13039/501100011033/FEDER, UE. M.C.S. and L.L. acknowledge partial support from a Maria de Maeztu grant (CEX2021-001164-M) funded by the MICIU/AEI/10.13039/501100011033 and from the European Commission Chips Joint Undertaking Project No. 101194363 (NEHIL)., With funding from the Spanish government through the "Maria de Maeztu Centre of Excellence" accreditation (CEX2021-001164-M)., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Otros (Other)

On the Role of Consistency Between Physics and Data in Physics-Informed Neural Networks (v1)

  • Becerra-Zuniga, Nicolás
  • Lacasa, Lucas
  • Valero, Eusebio
  • Rubio, Gonzalo
24 pages, 7 Figures, 3 Tables., Physics-informed neural networks (PINNs) have gained significant attention as a surrogate modeling strategy for partial differential equations (PDEs), particularly in regimes where labeled data are scarce and physical constraints can be leveraged to regularize the learning process. In practice, however, PINNs are frequently trained using experimental or numerical data that are not fully consistent with the governing equations due to measurement noise, discretization errors, or modeling assumptions. The implications of such data-to-PDE inconsistencies on the accuracy and convergence of PINNs remain insufficiently understood. In this work, we systematically analyze how data inconsistency fundamentally limits the attainable accuracy of PINNs. We introduce the concept of a consistency barrier, defined as an intrinsic lower bound on the error that arises from mismatches between the fidelity of the data and the exact enforcement of the PDE residual. To isolate and quantify this effect, we consider the 1D viscous Burgers equation with a manufactured analytical solution, which enables full control over data fidelity and residual errors. PINNs are trained using datasets of progressively increasing numerical accuracy, as well as perfectly consistent analytical data. Results show that while the inclusion of the PDE residual allows PINNs to partially mitigate low-fidelity data and recover the dominant physical structure, the training process ultimately saturates at an error level dictated by the data inconsistency. When high-fidelity numerical data are employed, PINN solutions become indistinguishable from those trained on analytical data, indicating that the consistency barrier is effectively removed. These findings clarify the interplay between data quality and physics enforcement in PINNs providing practical guidance for the construction and interpretation of physics-informed surrogate models., The authors acknowledge funding from project TIFON (PLEC2023-010251) funded by MCIN/AEI/10.13039/501100011033, Spain. This research has received funding from the European Union (ROSAS, project number 101138319). This research has received funding from the European Research Council Executive Agency under TRANSDIF-FUSE project, Grant Agreement No. 101167322. Views and opinions expressed are, however, those of the authors only and do not necessarily reflect those of the European Union. Neither the European Union nor the granting authority can be held responsible for them. LL acknowledges partial support from project CSxAI (PID2024-157526NB-I00) funded by MICIU/AEI/10.13039/501100011033/FEDER, UE, from a Maria de Maeztu Seal of Excellence grant (CEX2021-001164-M) funded by the MICIU/AEI/10.13039/501100011033, and from the European Commission Chips Joint Undertaking project No. 101194363 (NEHIL)., With funding from the Spanish government through the "Maria de Maeztu Centre of Excellence" accreditation (CEX2021-001164-M)., No
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Noise-Robust conceptors for physical reservoir computing: adaptation to perturbations

  • Infantes-Llinares, Gemma
  • Kang, Hongki
  • Soriano, Miguel C.
Conceptors are a powerful extension of reservoir computing (RC) that enable the selective recall and stabilization of internal dynamics. However, their application to physical RC remains challenging because measured reservoir states are inevitably affected by noise and physical perturbations. In this work, we propose a noise-robust cross-trial-correlation-based (CTC) method for computing conceptors in noisy reservoir systems. By exploiting the consistency of the reservoir response across repeated trials, the method suppresses noise contributions that are uncorrelated between measurements. Numerical simulations of leaky echo state networks under additive state noise and parameter drift show that CTC-based conceptors preserve the relevant internal dynamics and extend the operational range of the reservoir compared with standard conceptors and unconstrained reservoirs. In an autonomous-generation task, the CTC-based conceptor maintains predictive capability beyond 50% noise, where the other configurations fail to sustain autonomous generation. Under combined noise and parameter drift, the CTC approach maintains normalized root mean square error values below 0.3, while the alternative approaches considered exceed this error level in the tested conditions. These numerical results establish a concrete step towards adapting conceptor-based control to physical RC platforms., This work is supported by the European Union (EU) Chips JU Project No. 101194363 (NEHIL), by the Spanish State Research Agency, through the Severo Ochoa and María de Maeztu Program for Centers and Units of Excellence in R&D (CEX2021-001164-M) and by the National Research Foundation of Korea (NRF) grant funded by the Korea government (MSIT) (No. RS-2024-00439307)., With funding from the Spanish government through the "Maria de Maeztu Centre of Excellence" accreditation (CEX2021-001164-M)., Peer reviewed
Archivo Digital UPM
Publicación Artículo científico (JournalArticle)

A certifiable machine learning-based pipeline to predict fatigue life of aircraft structures

  • Ladrón Cordoba, Angel|||0009-0001-9467-2371
  • Sánchez Domínguez, Miguel|||0009-0001-2015-2824
  • Rozalén Pérez, Javier
  • Sánchez Moreno, Fernando R.
  • Vicente Buendía, Javier de|||0000-0002-3640-4782
  • Lacasa Saiz de Arce, Lucas|||0000-0003-3057-0357
  • Valero Sánchez, Eusebio|||0000-0002-1627-6883
  • Rubio Calzado, Gonzalo|||0000-0002-6231-4801
Archivo Digital UPM
Publicación Artículo científico (JournalArticle)

Transfer learning-enhanced deep reinforcement learning for aerodynamic airfoil optimization subject to structural constraints

  • Ramos Archilla, David|||0009-0002-0407-4624
  • Lacasa Saiz de Arce, Lucas|||0000-0003-3057-0357
  • Valero Sánchez, Eusebio|||0000-0002-1627-6883
  • Rubio Calzado, Gonzalo|||0000-0002-6231-4801