Skip to main content

ORQUESTACION INTELIGENTE DE COMPUTACION EDGE-CLOUD EN REDES RADIO MULTI-ACCESO PARA APLICACIONES SENSIBLES AL RETARDO

PID2022-142332OA-I00

•
Funding agency name Agencia Estatal de Investigación
Funding agency acronym AEI
Program Programa Estatal para Impulsar la Investigación Científico-Técnica y su Transferencia
Subprogram Subprograma Estatal de Generación de Conocimiento
Call Proyectos de I+D+i (Generación de Conocimiento y Retos Investigación)
Call year 2022
State Plan 2021-2023 Plan Estatal de Investigación Científica y Técnica y de Innovación
Beneficiary centre UNIVERSIDAD DE CASTILLA-LA MANCHA

Resultados relacionados

Resultados totales (Incluyendo duplicados): 2
Encontrada(s) 1 página(s)

UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Enhanced multi-task scheduling in MEC-enabled industrial systems: integrating deep reinforcement learning with optimizer experiences

  • Palomares Torrecilla, Javier|||0009-0003-6523-4887
  • Carmona Cejudo, Estela
  • Cervelló Pastor, Cristina|||0000-0002-8056-0774
  • Coronado, Estefanía
  • Siddiqui, Shuaib
In industrial multi-access edge computing (MEC), novel collaborative systems involving multiple automated guided vehicles (AGVs) require the execution of both critical tasks and computational tasks, such as AI-based collision avoidance. However, previous research focused mainly on scheduling process-related tasks and overlooked computational tasks. Moreover, scheduling tasks between AGVs in collaborative systems poses an integer problem, which is challenging to solve in polynomial time, highlighting the need for computationally efficient algorithms. This paper proposes a deep reinforcement learning (DRL)-based approach to multi-task scheduling (DRL-MTS) in multi-AGV systems. It involves dynamically applying a catalog of DRL models, each tailored to different numbers of AGVs. Evaluation results demonstrate that the proposed inter-AGV DRL-MTS strategy closely approaches the optimal solution, reaching up to 96% task completion compared to a 98% of the optimal solution, while significantly reducing decision times. Moreover, the training time for these models has been reduced threefold using datasets from existing optimization solvers, and transfer learning has further cut training times by up to 51%., This work was supported by the Spanish Ministry of Economic Affairs and Digital Transformation and the European Union – NextGeneration EU, under the Recovery Plan, Transformation and Resilience (PRTR) (UNICO I+D 5G 2021, ref. TSI-063000-2021-9-6GSMART-ICC), by the EU’s HE Innovation Actions grant agreement no. 101057083 (Zero-SWARM), by EU “NextGenerationEU/PRTR”, MCIN, and AEI under project IJC2020-043058-I and by the CERCA Programme / Generalitat de Catalunya and by MCIN/AEI/10.13039/501100011033 (FEDER “a way of making Europe”) under grant PID2022-142332OA-I00., Peer Reviewed
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Enhanced multi-task scheduling in MEC-enabled industrial systems: integrating deep reinforcement learning with optimizer experiences

  • Palomares Torrecilla, Javier
  • Carmona Cejudo, Estela
  • Cervelló Pastor, Cristina
  • Coronado, Estefanía
  • Siddiqui, Shuaib
In industrial multi-access edge computing (MEC), novel collaborative systems involving multiple automated guided vehicles (AGVs) require the execution of both critical tasks and computational tasks, such as AI-based collision avoidance. However, previous research focused mainly on scheduling process-related tasks and overlooked computational tasks. Moreover, scheduling tasks between AGVs in collaborative systems poses an integer problem, which is challenging to solve in polynomial time, highlighting the need for computationally efficient algorithms. This paper proposes a deep reinforcement learning (DRL)-based approach to multi-task scheduling (DRL-MTS) in multi-AGV systems. It involves dynamically applying a catalog of DRL models, each tailored to different numbers of AGVs. Evaluation results demonstrate that the proposed inter-AGV DRL-MTS strategy closely approaches the optimal solution, reaching up to 96% task completion compared to a 98% of the optimal solution, while significantly reducing decision times. Moreover, the training time for these models has been reduced threefold using datasets from existing optimization solvers, and transfer learning has further cut training times by up to 51%., This work was supported by the Spanish Ministry of Economic Affairs and Digital Transformation and the European Union – NextGeneration EU, under the Recovery Plan, Transformation and Resilience (PRTR) (UNICO I+D 5G 2021, ref. TSI-063000-2021-9-6GSMART-ICC), by the EU’s HE Innovation Actions grant agreement no. 101057083 (Zero-SWARM), by EU “NextGenerationEU/PRTR”, MCIN, and AEI under project IJC2020-043058-I and by the CERCA Programme / Generalitat de Catalunya and by MCIN/AEI/10.13039/501100011033 (FEDER “a way of making Europe”) under grant PID2022-142332OA-I00., Peer Reviewed, Postprint (published version)