Pasar al contenido principal

SUPERVISION DE FLOTA DE DRONES Y OPTIMIZACION DE LOS PLANES DE VUELO DE OPERACIONES COMERCIALES

PID2020-116377RB-C21

•
Nombre agencia financiadora Agencia Estatal de Investigación
Acrónimo agencia financiadora AEI
Programa Programa Estatal de I+D+i Orientado a los Retos de la Sociedad
Convocatoria Proyectos de I+D+i (Generación de Conocimiento y Retos Investigación)
Año convocatoria 2020
Plan Estatal 2017-2020 Plan Estatal de Investigación Científica y Técnica y de Innovación
Centro beneficiario UNIVERSITAT POLITECNICA DE CATALUNYA

Resultados relacionados

Resultados totales (Incluyendo duplicados): 8
Encontrada(s) 1 página(s)

UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Drone performance modelling for U-space strategic deconflicting services

  • Sánchez Segura, Albert|||0009-0008-3000-2871
  • Pastor Llorens, Enric|||0000-0002-7587-8702
  • Barrado Muxí, Cristina|||0000-0003-0100-724X
Integrating drones into U-space airspace demands accurate performance modelling to support strategic deconfliction and reliable 4D trajectory predictions. However, most commercially available drones lack standardised performance profiles, making current ATM-oriented models like BADA not directly usable for U-space services. This paper presents a kinematic, operationally-focused approach to drone performance modelling based on classical dynamic principles and real flight data from representative drone platforms. The methodology divides flight into key phases, such as turns, climbs, and transitions, to generate polynomial estimators that capture essential dynamic behaviour without requiring complex sub-system modelling. The proposed models are packaged for easy integration by Uspace service developers and validated against actual drone flight trajectories. Results show improved prediction accuracy, highlighting the value of tailored drone performance models in enabling safe and efficient U-space operations., This research was supported by grants PID2023-152053OB-C21 and PID2020-116377RB-C21, funded by MICIU/AEI /10.13039/501100011033 and by FEDER, UE., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Explainability of deep reinforcement learning method with drones

  • Çetin, Ender|||0000-0002-9258-1919
  • Barrado Muxí, Cristina|||0000-0003-0100-724X
  • Pastor Llorens, Enric|||0000-0002-7587-8702
Recent advances in artificial intelligence (AI) technology demonstrated that AI algorithms are very powerful as AI models become more complex. As a result, the users and also the engineers who developed the AI algorithms have a hard time explaining how the AI model gives the specific result. This phenomenon is known as "black box" and affects end-users’ confidence in these AI systems. In this research, explainability of deep reinforcement learning is investigated for counter-drone systems. To counter a drone, a deep reinforcement learning method such as double deep Q-network with dueling architecture and prioritized experience replay is proposed. In counter-drone systems, catching the target as soon as possible is expected. Otherwise, the target can be gone in a short time. To understand how the agent performs more quickly and accurately, figures representing rewards, drone locations, crash positions, and the distribution of actions are analyzed and compared. For example, the positions of the drones in a successful episode during training can be analyzed by the actions the agent performed and the rewards in this episode. In addition, the actions agent took in episodes are compared with action frequencies during training and it is seen that at the end of the training, the agent selects the dominant actions throughout the training. However, at the beginning of the training, the distribution of actions is not correlated with the actions selected at the end. The results showed that the agent uses different flight paths by using different actions to catch the target drone in different episodes and different models. Finally, the generation of a saliency map is investigated to identify the critical regions in an input image which influences the predictions made by the DQN agent by evaluating the gradients of the model’s output with respect to both the image and scalar inputs., This work was funded by the Ministry of Science and Innovation of Spain under grant PID2020-116377RB-C21., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Insights of the citizens perception during a 3-days outdoors flight demonstration

  • Barrado Muxí, Cristina|||0000-0003-0100-724X
  • Kuljanin, Jovana|||0000-0002-3380-262X
  • Salamí San Juan, Esther|||0000-0002-4635-2963
  • Pastor Llorens, Enric|||0000-0002-7587-8702
Citizens are getting used to seeing more and more drones flying in the sky, but this is still a sporadic situation and it is dif¿cult to experience it in urban environments. The reason is that in low-populated areas the safety regulations are more permissible than in populated areas. With the exception of drone shows, the operations that citizens may observe in urban areas are mainly the ones devoted to security or law enforcement. The CORUS-XUAM project ran six drone flight demonstrations of urban air mobility in seven different European countries. Flights were demonstrated in Sweden, Germany, Belgium, Italy, France and Spain. In the case of the Spanish demonstration, drones were flying over the beach of Castelldefels, an urban area in which citizens go for a promenade. This situation was ideal to capture opinions from the citizens not involved in the operations. In addition, the number of flights accounted for 72 delivery operations and lasted three days. As part of the exercise evaluation a number of surveys was collected. From a total of 77 surveys responded during these exercises, 37 corresponded to citizens’ opinions. During the flight demonstrations we also captured the sound pressure and recorded some drone noises. In this paper we will present the citizens’ responses related to noise and will try to find correlations with the captured sound pressure and noise recordings. The results of this analysis can be directly used in the MUSE project to further refine the noise parameters that are perceived as more annoying by the citizens., This paper is partially funded by the Ministry Science and Education of Spain, under fund grant PID2020-116377RB-C21, and is also part of the MUSE project that has received fund- ing from the SESAR 3 Joint Undertaking (SESAR 3 JU) under grant No 101114858. The JU receives support from the European Union’s Horizon Europe research and innovation prgramme and the SESAR 3 JU members other than the Union. The resuls and opinions re- flect only the authors’ view and the SESAR JU and the Spanish Ministry are not responsible of any use that may be made of the information it contains., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Counter a drone and the performance analysis of deep reinforcement learning method and human pilot

  • Çetin, Ender|||0000-0002-9258-1919
  • Barrado Muxí, Cristina|||0000-0003-0100-724X
  • Pastor Llorens, Enric|||0000-0002-7587-8702
Artificial Intelligence (AI) has been used in different research areas in aerospace to create an intelligent system. Especially, an unmanned aerial vehicle (UAV), known as a drone, can be controlled by AI methods such as deep reinforcement learning (DRL) in different purposes. Drones with DRL become more intelligent and eventually they can be fully autonomous. In this paper, DRL method supported by real time object detection model is proposed to detect and catch a drone. Additionally, the results are analyzed by comparing the time to catch the target drone in seconds between DRL method, human pilot and an algorithm which directs the drone towards the target position without using any AI method or navigation and guidance method. The main idea is to catch a drone in an environment as fast as possible without crashing any obstacles inside the environment. In DRL method, the agent is a quadcopter drone and it is rewarded in each time step by the environment provided by Airsim flight simulator. Drone is trained to catch the target drone by using DRL model which is based on deep Q-Network algorithm. After training, the tests have been made by the agent drone with DRL model and human pilots to catch stationary and non-stationary target drone. The training and test results show that the agent drone learns to catch target drone which can be a stationary and a non-stationary. In addition. the agent avoids crashing any obstacles in the environment with a minimum success rate of 94%. Also, DRL model performance is compared with the human pilot performances and the agent with DRL model shows better time to catch the target drone. Human pilots struggle to control the drone by using remote controller when catching the target in simulation. However, the agent with DRL model is rarely missing the target when trying to catch the target., This work was funded partially by the AGAUR under grant 2020PANDE00141, the Ministry of Science and Innovation of Spain under grant PID2020-116377RB-C21 and the SESAR Joint Undertaking (JU) project CORUS-XUAM, under grant SESAR-VLD2 101017682. The JU receives support from the European Union’s Horizon 2020 research and innovation programme and the SESAR JU members other than the Union. Special thanks to Dr. Pablo Royo Chic for his assistance to our paper by piloting a drone to catch the target drone.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Counter a drone and the performance analysis of deep reinforcement learning method and human pilot

  • Çetin, Ender
  • Barrado Muxí, Cristina
  • Pastor Llorens, Enric
Artificial Intelligence (AI) has been used in different research areas in aerospace to create an intelligent system. Especially, an unmanned aerial vehicle (UAV), known as a drone, can be controlled by AI methods such as deep reinforcement learning (DRL) in different purposes. Drones with DRL become more intelligent and eventually they can be fully autonomous. In this paper, DRL method supported by real time object detection model is proposed to detect and catch a drone. Additionally, the results are analyzed by comparing the time to catch the target drone in seconds between DRL method, human pilot and an algorithm which directs the drone towards the target position without using any AI method or navigation and guidance method. The main idea is to catch a drone in an environment as fast as possible without crashing any obstacles inside the environment. In DRL method, the agent is a quadcopter drone and it is rewarded in each time step by the environment provided by Airsim flight simulator. Drone is trained to catch the target drone by using DRL model which is based on deep Q-Network algorithm. After training, the tests have been made by the agent drone with DRL model and human pilots to catch stationary and non-stationary target drone. The training and test results show that the agent drone learns to catch target drone which can be a stationary and a non-stationary. In addition. the agent avoids crashing any obstacles in the environment with a minimum success rate of 94%. Also, DRL model performance is compared with the human pilot performances and the agent with DRL model shows better time to catch the target drone. Human pilots struggle to control the drone by using remote controller when catching the target in simulation. However, the agent with DRL model is rarely missing the target when trying to catch the target., This work was funded partially by the AGAUR under grant 2020PANDE00141, the Ministry of Science and Innovation of Spain under grant PID2020-116377RB-C21 and the SESAR Joint Undertaking (JU) project CORUS-XUAM, under grant SESAR-VLD2 101017682. The JU receives support from the European Union’s Horizon 2020 research and innovation programme and the SESAR JU members other than the Union. Special thanks to Dr. Pablo Royo Chic for his assistance to our paper by piloting a drone to catch the target drone., Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Insights of the citizens perception during a 3-days outdoors flight demonstration

  • Barrado Muxí, Cristina
  • Kuljanin, Jovana
  • Salamí San Juan, Esther
  • Pastor Llorens, Enric
Citizens are getting used to seeing more and more drones flying in the sky, but this is still a sporadic situation and it is dif¿cult to experience it in urban environments. The reason is that in low-populated areas the safety regulations are more permissible than in populated areas. With the exception of drone shows, the operations that citizens may observe in urban areas are mainly the ones devoted to security or law enforcement. The CORUS-XUAM project ran six drone flight demonstrations of urban air mobility in seven different European countries. Flights were demonstrated in Sweden, Germany, Belgium, Italy, France and Spain. In the case of the Spanish demonstration, drones were flying over the beach of Castelldefels, an urban area in which citizens go for a promenade. This situation was ideal to capture opinions from the citizens not involved in the operations. In addition, the number of flights accounted for 72 delivery operations and lasted three days. As part of the exercise evaluation a number of surveys was collected. From a total of 77 surveys responded during these exercises, 37 corresponded to citizens’ opinions. During the flight demonstrations we also captured the sound pressure and recorded some drone noises. In this paper we will present the citizens’ responses related to noise and will try to find correlations with the captured sound pressure and noise recordings. The results of this analysis can be directly used in the MUSE project to further refine the noise parameters that are perceived as more annoying by the citizens., This paper is partially funded by the Ministry Science and Education of Spain, under fund grant PID2020-116377RB-C21, and is also part of the MUSE project that has received fund- ing from the SESAR 3 Joint Undertaking (SESAR 3 JU) under grant No 101114858. The JU receives support from the European Union’s Horizon Europe research and innovation prgramme and the SESAR 3 JU members other than the Union. The resuls and opinions re- flect only the authors’ view and the SESAR JU and the Spanish Ministry are not responsible of any use that may be made of the information it contains., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Explainability of deep reinforcement learning method with drones

  • Çetin, Ender
  • Barrado Muxí, Cristina
  • Pastor Llorens, Enric
Recent advances in artificial intelligence (AI) technology demonstrated that AI algorithms are very powerful as AI models become more complex. As a result, the users and also the engineers who developed the AI algorithms have a hard time explaining how the AI model gives the specific result. This phenomenon is known as "black box" and affects end-users’ confidence in these AI systems. In this research, explainability of deep reinforcement learning is investigated for counter-drone systems. To counter a drone, a deep reinforcement learning method such as double deep Q-network with dueling architecture and prioritized experience replay is proposed. In counter-drone systems, catching the target as soon as possible is expected. Otherwise, the target can be gone in a short time. To understand how the agent performs more quickly and accurately, figures representing rewards, drone locations, crash positions, and the distribution of actions are analyzed and compared. For example, the positions of the drones in a successful episode during training can be analyzed by the actions the agent performed and the rewards in this episode. In addition, the actions agent took in episodes are compared with action frequencies during training and it is seen that at the end of the training, the agent selects the dominant actions throughout the training. However, at the beginning of the training, the distribution of actions is not correlated with the actions selected at the end. The results showed that the agent uses different flight paths by using different actions to catch the target drone in different episodes and different models. Finally, the generation of a saliency map is investigated to identify the critical regions in an input image which influences the predictions made by the DQN agent by evaluating the gradients of the model’s output with respect to both the image and scalar inputs., This work was funded by the Ministry of Science and Innovation of Spain under grant PID2020-116377RB-C21., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Drone performance modelling for U-space strategic deconflicting services

  • Sánchez Segura, Albert
  • Pastor Llorens, Enric
  • Barrado Muxí, Cristina
Integrating drones into U-space airspace demands accurate performance modelling to support strategic deconfliction and reliable 4D trajectory predictions. However, most commercially available drones lack standardised performance profiles, making current ATM-oriented models like BADA not directly usable for U-space services. This paper presents a kinematic, operationally-focused approach to drone performance modelling based on classical dynamic principles and real flight data from representative drone platforms. The methodology divides flight into key phases, such as turns, climbs, and transitions, to generate polynomial estimators that capture essential dynamic behaviour without requiring complex sub-system modelling. The proposed models are packaged for easy integration by Uspace service developers and validated against actual drone flight trajectories. Results show improved prediction accuracy, highlighting the value of tailored drone performance models in enabling safe and efficient U-space operations., This research was supported by grants PID2023-152053OB-C21 and PID2020-116377RB-C21, funded by MICIU/AEI /10.13039/501100011033 and by FEDER, UE., Peer Reviewed, Postprint (published version)