UPCommons. Portal del coneixement obert de la UPC
Publicación
Contribución de congreso (ConferenceOutput)
Enhanced multi-task scheduling in MEC-enabled industrial systems: integrating deep reinforcement learning with optimizer experiences
In industrial multi-access edge computing (MEC), novel collaborative systems involving multiple automated guided vehicles (AGVs) require the execution of both critical tasks and computational tasks, such as AI-based collision avoidance. However, previous research focused mainly on scheduling process-related tasks and overlooked computational tasks. Moreover, scheduling tasks between AGVs in collaborative systems poses an integer problem, which is challenging to solve in polynomial time, highlighting the need for computationally efficient algorithms. This paper proposes a deep reinforcement learning (DRL)-based approach to multi-task scheduling (DRL-MTS) in multi-AGV systems. It involves dynamically applying a catalog of DRL models, each tailored to different numbers of AGVs. Evaluation results demonstrate that the proposed inter-AGV DRL-MTS strategy closely approaches the optimal solution, reaching up to 96% task completion compared to a 98% of the optimal solution, while significantly reducing decision times. Moreover, the training time for these models has been reduced threefold using datasets from existing optimization solvers, and transfer learning has further cut training times by up to 51%., This work was supported by the Spanish Ministry of
Economic Affairs and Digital Transformation and the European Union – NextGeneration EU, under the Recovery
Plan, Transformation and Resilience (PRTR) (UNICO I+D
5G 2021, ref. TSI-063000-2021-9-6GSMART-ICC), by the
EU’s HE Innovation Actions grant agreement no. 101057083
(Zero-SWARM), by EU “NextGenerationEU/PRTR”, MCIN,
and AEI under project IJC2020-043058-I and by the
CERCA Programme / Generalitat de Catalunya and by
MCIN/AEI/10.13039/501100011033 (FEDER “a way of making Europe”) under grant PID2022-142332OA-I00., Peer Reviewed