Skip to main content

GENERACION DE AVATARES REALISTAS EN ENTORNOS NO CONTROLADOS

PID2023-151184OB-I00

•
Funding agency name Agencia Estatal de Investigación
Funding agency acronym AEI
Program Programa Estatal para Impulsar la Investigación Científico-Técnica y su Transferencia
Subprogram Subprograma Estatal de Generación de Conocimiento
Call Proyectos de I+D+i (Generación de Conocimiento y Retos Investigación)
Call year 2023
State Plan 2021-2023 Plan Estatal de Investigación Científica y Técnica y de Innovación
Beneficiary centre AGENCIA ESTATAL CONSEJO SUPERIOR DE INVESTIGACIONES CIENTIFICAS (CSIC)

Resultados relacionados

Resultados totales (Incluyendo duplicados): 1
Encontrada(s) 1 página(s)

UPCommons. Portal del coneixement obert de la UPC
Publication Capítulo o parte de un libro (BookPart)

TranSPORTmer: a holistic approach to trajectory understanding in multi-agent sports scenarios

  • Capellera Font, Guillem
  • Ferraz Colomina, Luis
  • Rubio Romano, Antonio
  • Agudo Martínez, Antonio|||0000-0001-6845-4998
  • Moreno-Noguer, Francesc
Understanding trajectories in multi-agent scenarios requires addressing diverse tasks, including predicting future movements, imputing missing observations, inferring the status of unseen agents, and classifying different states. Traditional data-driven approaches often handle these tasks independently, utilizing specific models tailored for individual purposes. In this paper, we introduce TranSPORTmer, a unified framework capable of simultaneously addressing all these tasks at once, showcasing its application to the intricate dynamics of multi-agent soccer and basketball scenarios. TranSPORTmer builds upon a Transformer architecture and employs Set Attention Blocks sequentially to model trajectories in an equivariant manner, effectively capturing temporal dynamics and social interactions among agents. The model’s task is guided by an input mask, concealing missing or yet-to-be-predicted observations. Additionally, we introduce a CLS extra agent to classify states along soccer trajectories, including passes, possessions, out-of-play intervals, and uncontrolled states, contributing to an enhancement in modeling trajectories. To validate TranSPORTmer’s efficacy, we conducted a thorough evaluation on a soccer and two basketball datasets. Across various metrics, we demonstrate that our general-purpose model consistently outperforms task-specific state-of-the-art architectures in player forecasting, unified player forecasting-imputation, ball inference, and ball imputation., This work has been supported by the project GRAVATAR PID2023-151184OB-I00 funded by MCIU/AEI/10.13039/501100011033 and by ERDF, UE and by the Government of Catalonia under 2023 DI 00058