DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación
Contribución de congreso (ConferenceOutput)
Effects of a social force model reward in robot navigation based on deep reinforcement learning
Trabajo presentado en el 4th Iberian Robotics Conference, celebrado en Oporto (Portugal) en noviembre de 2019, In this paper is proposed an inclusion of the Social Force Model (SFM) into a concrete Deep Reinforcement Learning (RL) framework for robot navigation. These types of techniques have demonstrated to be useful to deal with different types of environments to achieve a goal. In Deep RL, a description of the world to describe the states and a reward adapted to the environment are crucial elements to get the desire behaviour and achieve a high performance. For this reason, this work adds a dense reward function based on SFM and uses the forces in the states like an additional description. Furthermore, obstacles are added to improve the behaviour of works that only consider moving agents. This SFM inclusion can offer a better description of the obstacles for the navigation. Several simulations have been done to check the effects of these modifications in the average performance., Work supported by the Spanish Ministry of Science and Innovation under project ColRobTransp (DPI2016-78957-RAEI/FEDER EU) and by the Spanish State Research Agency through the María de Maeztu Seal of Excellence to IRI (MDM-2016-0656). Óscar Gil is also supported by Spanish Ministry of Science and Innovation under a FPI-grant, BES-2017-082126.
Proyecto:
MINECO / Plan Estatal de Investigación Científica y Técnica y de Innovación 2013-2016 DPI2016-78957-R
,
MINECO / Plan Estatal de Investigación Científica y Técnica y de Innovación 2013-2016 MDM-2016-0656
,
MINECO / Plan Estatal de Investigación Científica y Técnica y de Innovación 2013-2016 DPI2016-78876-R