RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación
Artículo científico (JournalArticle)
Using Transformers and Reinforcement Learning for the Team Orienteering Problem Under Dynamic Conditions
[EN] This paper presents a reinforcement learning (RL) approach for solving the team orienteering problem under both deterministic and dynamic travel time conditions. The proposed method builds on the transformer architecture and is trained to construct routes that adapt to real-time variations, such as traffic and environmental changes. A key contribution of this work is the model's ability to generalize across problem instances with varying numbers of nodes and vehicles, eliminating the need for retraining when problem size changes. To assess performance, a comprehensive set of experiments involving 27,000 synthetic instances is conducted, comparing the RL model with a variable neighborhood search metaheuristic. The results indicate that the RL model achieves competitive solution quality while requiring significantly less computational time. Moreover, the RL approach consistently produces feasible solutions across all dynamic instances, demonstrating strong robustness in meeting time constraints. These findings suggest that learning-based methods can offer efficient, scalable, and adaptable solutions for routing problems in dynamic and uncertain environments., The present work has been partially supported by the Spanish Government (IA4TES project 'Artificial Intelligence for Sustainable Energy Transition'), the Spanish Ministry of Science-AEI (PID2022- 138860NB-I00 and RED2022-134703-T), the European Commission (AIDEAS HORIZON-CL4- 2021-TWIN-TRANSITION-01-07-101057294). This publication is also part of the DIN2024-013395 grant, funded by MICIU/AEI/ 10.13039/501100011033.
Proyecto:
European Commission / HE 101057294
,
Agencia Estatal de Investigación / Plan Estatal de Investigación Científica y Técnica y de Innovación 2021-2023 PID2022-138860NB-I00
,
Generalitat Valenciana / Programa Prometeo para Grupos de Investigación de Excelencia de la Generalitat Valenciana PROMETEO/2021/065
,
Agencia Estatal de Investigación DIN2024-013395
,
Ministerio de Ciencia e Innovación RED2022-134703-T