Skip to main content

Resultados relacionados

Resultados totales (Incluyendo duplicados): 8
Encontrada(s) 1 página(s)

Repositorio Digital de la UPF
Publication Contribución de congreso (ConferenceOutput)

Self-supervised small soccer player detection and tracking

  • Hurault, Samuel
  • Ballester, Coloma
  • Haro Ortega, Gloria
Comunicació presentada al MMSports '20: The 3rd International Workshop on Multimedia Content Analysis in Sports, celebrat el 16 d'octubre de 2020 de manera virtual., In a soccer game, the information provided by detecting and tracking brings crucial clues to further analyze and understand some tactical aspects of the game, including individual and team actions. State-of-the-art tracking algorithms achieve impressive results in scenarios on which they have been trained for, but they fail in challenging ones such as soccer games. This is frequently due to the player small relative size and the similar appearance among players of the same team. Although a straightforward solution would be to retrain these models by using a more specific dataset, the lack of such publicly available annotated datasets entails searching for other effective solutions. In this work, we propose a self-supervised pipeline which is able to detect and track low-resolution soccer players under different recording conditions without any need of ground-truth data. Extensive quantitative and qualitative experimental results are presented evaluating its performance. We also present a comparison to several state-of-the-art methods showing that both the proposed detector and the proposed tracker achieve top-tier results, in particular in the presence of small players., SH acknowledges support by ENS Paris-Saclay. CB and GH acknowledge support by MICINN/FEDER UE project, ref. PGC2018-098625- B-I00, H2020-MSCA-RISE-2017 project, ref. 777826 NoMADS, and RED2018-102511-T.
Repositorio Digital de la UPF
Publication Capítulo o parte de un libro (BookPart)

An analysis of generative methods for multiple image inpainting

  • Ballester, Coloma
  • Bugeau, Aurélie
  • Hurault, Samuel
  • Parisotto, Simone
  • Vitoria, Patricia
Image inpainting refers to the restoration of an image with missing regions in a way that is not detectable by the observer. The inpainting regions can be of any size and shape. This is an ill-posed inverse problem that does not have a unique solution. In this work, we focus on learning-based image completion methods for multiple and diverse inpainting which goal is to provide a set of distinct solutions for a given damaged image. These methods capitalize on the probabilistic nature of certain deep generative models to sample various solutions that coherently restore the missing content. Throughout the chapter, we will analyze the underlying theory and analyze the recent proposals for multiple inpainting. To investigate the pros and cons of each method, we present quantitative and qualitative comparisons, on common datasets, regarding both the quality and the diversity of the set of inpainted solutions. Our analysis allows us to identify the most successful generative strategies in both inpainting quality and inpainting diversity. This task is closely related to the learning of an accurate probability distribution of images. Depending on the dataset in use, the challenges that entail the training of such a model will be discussed through the analysis., PV, CB and AB acknowledge the EU Horizon 2020 research and innovation programme NoMADS (Marie Skłodowska-Curie grant agreement No 777826). SP acknowledges the Leverhulme Trust Research Project Grant “Unveiling the invisible: Mathematics for Conservation in Arts and Humanities”. CB and PV also acknowledge partial support by MICINN/FEDER UE project, ref. PGC2018-098625-B-I00, and RED2018-102511-T. AB also acknowledges the French Research Agency through the PostProdLEAP project (ANR-19-CE23-0027-01). SH acknowledges the French ministry of research through a CDSN grant of ENS Paris-Saclay
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publication Artículo científico (JournalArticle)

Study of Convolutional Neural Networks for Global Parametric Motion Estimation on Log-Polar Imagery

  • Traver, V. Javier
  • Paredes Palacios, Roberto
[EN] The problem of motion estimation from images has been widely studied in the past. Although many mature solutions exist, there are still open issues and challenges to be addressed. For instance, in spite of the well-known performance of convolutional neural networks (CNNs) in many computer vision problems, only very recent work has started to explore CNNs to learning to estimate motion, as an alternative to manually-designed algorithms. These few initial efforts, however, have focused on conventional Cartesian images, while other imaging models have not been studied. This work explores the yet unknown role of CNNs in estimating global parametric motion in log-polar images. Despite its favourable properties, estimating some motion components in this model has proven particularly challenging with past approaches. It is therefore highly important to understand how CNNs behave when their input are log-polar images, since they involve a complex mapping in the motion model, a polar image geometry, and space-variant resolution. To this end, a CNN is considered in this work for regressing the motion parameters. Experiments on existing image datasets using synthetic image deformations reveal that, interestingly, standard CNNs can successfully learn to estimate global parametric motion on log-polar images with accuracies comparable to or better than with Cartesian images., This work was supported in part by the Universitat Jaume I, Castellon, Spain, through the Pla de promocio de la investigacio, under Project UJI-B2018-44; and in part by the Spanish Ministerio de Ciencia, Innovacion y Universidades through the Research Network under Grant RED2018-102511-T.
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Contribución de congreso (ConferenceOutput)

Understanding event boundaries for egocentric activity recognition from photo-streams

  • Cartas, Alejandro
  • Talavera, Estefanía
  • Radeva, Petia
  • Dimiccoli, Mariella
Trabajo presentado en el ICPR International Workshops and Challenges, celebrado de forma virtual del 10 al 15 de enero de 2021, The recognition of human activities captured by a wearable photo-camera is especially suited for understanding the behavior of a person. However, it has received comparatively little attention with respect to activity recognition from fixed cameras.In this work, we propose to use segmented events from photo-streams as temporal boundaries to improve the performance of activity recognition. Furthermore, we robustly measure its effectiveness when images of the evaluated person have been seen during training, and when the person is completely unknown during testing. Experimental results show that leveraging temporal boundary information on pictures of seen people improves all classification metrics, particularly it improves the classification accuracy up to 85.73%., Lecture Notes in Computer Science 12663, This work was partially funded by projects RTI2018-095232-B-C2, SGR 1742, CERCA, Nestore Horizon2020 SC1-PM-15-2017 (n 769643), Validithi EIT Health Program, and the Spanish Ministry of Economy and Competitiveness and the European Regional Development Fund (MINECO/ERDF, EU) through the program Ramon y Cajal, the national Spanish project PID2019-110977GA-I00 and the Spanish national network RED2018-102511-T. A. Cartas supported by a doctoral fellowship from the Mexican Council of Science and Technology (CONACYT) (grant-no. 366596). The authors acknowledge the support of NVIDIA Corporation for hardware donation.
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Artículo científico (JournalArticle)

Visual event-based egocentric human action recognition

  • Moreno-Noguer, Francesc
  • Traver, V. Javier
  • Barranco, Francisco
  • Dimiccoli, Mariella
  • Pla, Filiberto
Trabajo presentado en la 10th Iberian Conference on Pattern Recognition and Image Analysis, celebrada en Aveiro (Portugal), del 4 al 6 de mayo de 2022, This paper lies at the intersection of three research areas: human action recognition, egocentric vision, and visual event-based sensors. The main goal is the comparison of egocentric action recognition performance under either of two visual sources: conventional images, or event-based visual data. In this work, the events, as triggered by asynchronous event sensors or their simulation, are spatio-temporally aggregated into event frames (a grid-like representation). This allows to use exactly the same neural model for both visual sources, thus easing a fair comparison. Specifically, a hybrid neural architecture combining a convolutional neural network and a recurrent network is used. It is empirically found that this general architecture works for both, conventional gray-level frames, and event frames. This finding is relevant because it reveals that no modification or adaptation is strictly required to deal with event data for egocentric action classification. Interestingly, action recognition is found to perform better with event frames, suggesting that these data provide discriminative information that aids the neural model to learn good features., Work supported by project UJI-B2018-44 from Pla de promoció de la investigació de la Universitat Jaume I, Spain, the research network RED2018-102511-T, from the Spanish Ministerio de Ciencia, Innovación y Universidades, and by National Grant PID2019-109434RA-I00/ SRA (State Research Agency /10.13039/501100011033)., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Artículo científico (JournalArticle)

Enhancing egocentric 3D pose estimation with third person views

  • Dhamanaskar, Ameya
  • Dimiccoli, Mariella
  • Corona, Enric
  • Pumarola, Albert
  • Moreno-Noguer, Francesc
We propose a novel approach to enhance the 3D body pose estimation of a person computed from videos captured from a single wearable camera. The main technical contribution consists of leveraging high-level features linking first- and third-views in a joint embedding space. To learn such embedding space we introduce First2Third-Pose, a new paired synchronized dataset of nearly 2000 videos depicting human activities captured from both first- and third-view perspectives. We explicitly consider spatial- and motion-domain features, combined using a semi-Siamese architecture trained in a self-supervised fashion. Experimental results demonstrate that the joint multi-view embedded space learned with our dataset is useful to extract discriminatory features from arbitrary single-view egocentric videos, with no need to perform any sort of domain adaptation or knowledge of camera parameters. An extensive evaluation demonstrates that we achieve significant improvement in egocentric 3D body pose estimation performance on two unconstrained datasets, over three supervised state-of-the-art approaches. The collected dataset and pre-trained model are available for research purposes., This work has been partially supported by projects PID2020-120049RB-I00 and PID2019-110977GA-I00 funded by MCIN/ AEI /10.13039/501100011033 and by the “European Union NextGenerationEU/PRTR”, as well as by grant RYC-2017-22563 funded by MCIN/ AEI /10.13039/501100011033 and by “ESF Investing in your future”, and network RED2018-102511-T funded by MCIN/ AEI., Peer reviewed
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Self-supervised small soccer player detection and tracking

  • Hurault, Samuel
  • Ballester, Coloma
  • Haro Ortega, Gloria
Comunicació presentada al MMSports '20: The 3rd International Workshop on Multimedia Content Analysis in Sports, celebrat el 16 d'octubre de 2020 de manera virtual., In a soccer game, the information provided by detecting and tracking brings crucial clues to further analyze and understand some tactical aspects of the game, including individual and team actions. State-of-the-art tracking algorithms achieve impressive results in scenarios on which they have been trained for, but they fail in challenging ones such as soccer games. This is frequently due to the player small relative size and the similar appearance among players of the same team. Although a straightforward solution would be to retrain these models by using a more specific dataset, the lack of such publicly available annotated datasets entails searching for other effective solutions. In this work, we propose a self-supervised pipeline which is able to detect and track low-resolution soccer players under different recording conditions without any need of ground-truth data. Extensive quantitative and qualitative experimental results are presented evaluating its performance. We also present a comparison to several state-of-the-art methods showing that both the proposed detector and the proposed tracker achieve top-tier results, in particular in the presence of small players., SH acknowledges support by ENS Paris-Saclay. CB and GH acknowledge support by MICINN/FEDER UE project, ref. PGC2018-098625- B-I00, H2020-MSCA-RISE-2017 project, ref. 777826 NoMADS, and RED2018-102511-T.
Recercat. Dipósit de la Recerca de Catalunya
Publication Capítulo o parte de un libro (BookPart)

An analysis of generative methods for multiple image inpainting

  • Ballester, Coloma
  • Bugeau, Aurélie
  • Hurault, Samuel
  • Parisotto, Simone
  • Vitoria, Patricia
Image inpainting refers to the restoration of an image with missing regions in a way that is not detectable by the observer. The inpainting regions can be of any size and shape. This is an ill-posed inverse problem that does not have a unique solution. In this work, we focus on learning-based image completion methods for multiple and diverse inpainting which goal is to provide a set of distinct solutions for a given damaged image. These methods capitalize on the probabilistic nature of certain deep generative models to sample various solutions that coherently restore the missing content. Throughout the chapter, we will analyze the underlying theory and analyze the recent proposals for multiple inpainting. To investigate the pros and cons of each method, we present quantitative and qualitative comparisons, on common datasets, regarding both the quality and the diversity of the set of inpainted solutions. Our analysis allows us to identify the most successful generative strategies in both inpainting quality and inpainting diversity. This task is closely related to the learning of an accurate probability distribution of images. Depending on the dataset in use, the challenges that entail the training of such a model will be discussed through the analysis., PV, CB and AB acknowledge the EU Horizon 2020 research and innovation programme NoMADS (Marie Skłodowska-Curie grant agreement No 777826). SP acknowledges the Leverhulme Trust Research Project Grant “Unveiling the invisible: Mathematics for Conservation in Arts and Humanities”. CB and PV also acknowledge partial support by MICINN/FEDER UE project, ref. PGC2018-098625-B-I00, and RED2018-102511-T. AB also acknowledges the French Research Agency through the PostProdLEAP project (ANR-19-CE23-0027-01). SH acknowledges the French ministry of research through a CDSN grant of ENS Paris-Saclay