Skip to main content

Resultados relacionados

Resultados totales (Incluyendo duplicados): 12
Encontrada(s) 1 página(s)

Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

An affine invariant patch similarity

  • Fedorov, Vadim
  • Ballester, Coloma
Image and video comparison is often approached by comparing patches of visual information. In this work we present a detailed description and implementation of an affine invariant patch simi- larity measure that performs an appropriate patch comparison by automatically and intrinsically adapting the size and shape of the patches. We also describe the complete implementation of the proposed iterative algorithm for computation of those shape-adaptive patches around each point in the image domain., The authors acknowledge partial support by MINECO/FEDER UE project, reference TIN2015- 70410-C2-1-R, by GRC reference 2014 SGR 1301 Generalitat de Catalunya, and by H2020-MSCARISE-2017 project, reference 777826 NoMADS.
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Towards soccer pass feasibility maps: the role of players’ orientation

  • Arbués Sangüesa, Adrià
  • Martin, Adrian
  • Fernández, Javier
  • Haro Ortega, Gloria
  • Ballester, Coloma
Once player tracking has been established as one of the main data sources in soccer, many challenges have emerged for data scientists, who attempt to recognize patterns from 2D trajectories in order to build tools that might help coaches to improve the performance of their teams. For instance, pass models predict where the ball should go next during pass events. However, existing models are mainly fed with players’ location and prior data, hence omitting critical pieces of information such as players’ body orientation. This paper presents a computational model to obtain pass feasibility maps, where player orientation is exploited and analysed. As a matter of fact, orientation proves to be crucial when modelling field-of-view and correct positioning of players, since it limits the potential receiving area of all candidates. Different proposals are given to evaluate the proposed pass feasibility map, reaching 0.46 and 0.79 in Top1 and Top3 accuracy, respectively, with a + 0.2 boost obtained after merging positional data with orientation., This work was supported by MICINN / FEDER UE (Funded by Ministerio de Ciencia, Innovación y Universidades) under Grants PGC2018-098625-B-I00 and FJCI-2017-31758, European Comission, HORIZON 2020 under grant 777826 NoMADS, and Ministerio de Ciencia, Innovación y Universidades (Redes Temáticas de Investigación) under grant RED2018-102511-T.
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Conditioned source separation for musical instrument performances

  • Slizovskaia, Olga
  • Haro Ortega, Gloria
  • Gómez Gutiérrez, Emilia, 1975-
In music source separation, the number of sources may vary for each piece and some of the sources may belong to the same family of instruments, thus sharing timbral characteristics and making the sources more correlated. This leads to additional challenges in the source separation problem. This paper proposes a source separation method for multiple musical instruments sounding simultaneously and explores how much additional information apart from the audio stream can lift the quality of source separation. We explore conditioning techniques at different levels of a primary source separation network and utilize two extra modalities of data, namely presence or absence of instruments in the mixture, and the corresponding video stream data., This work was funded in part by ERC Innovation Programme (grant 770376, TROMPA); Spanish Ministry of Economy and Competitiveness under the Mar´ıa de Maeztu Units of Excellence Program (MDM-2015-0502) and the Social European Funds; the MICINN/FEDER UE project with reference PGC2018-098625-B-I00; and the H2020-MSCARISE-2017 project with reference 777826 NoMADS. We gratefully acknowledge NVIDIA for the donation of GPUs used for the experiments.
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

An analysis and speedup of the FALDOI method for Optical Flow estimation

  • Gamonal, Ferran P.
  • Ballester, Coloma
  • Haro Ortega, Gloria
  • Meinhardt Llopis, Enric
  • Palomares, Roberto P.
We present a detailed analysis of FALDOI, a large displacement optical flow method proposed by P. Palomares et al. This method requires a set of discrete matches, which can be extremely sparse, and an energy functional which locally guides the interpolation from the matches. It follows a two-step minimization method at the finest scale which is very robust to the outliers of the sparse matcher and can capture large displacements of small objects. The results shown in the original paper consistently outperformed the coarse-to-fine approaches and achieved good qualitative and quantitative performance on the standard optical flow benchmarks. In this paper we revise the proposed method and the changes done to significantly reduce its execution time while reporting nearly the same accuracy. Finally, we also compare it against the current state-of-the-art to assess its performance., The authors acknowledge support by TIN2015-70410-C2-1-R(MINECO/FEDER, UE) project and by H2020-MSCA-RISE-2017 project, reference 777826 NoMADS.
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

On anisotropic optical flow inpainting algorithms

  • Raad, Lara
  • Oliver Parera, Maria
  • Ballester, Coloma
  • Haro Ortega, Gloria
  • Meinhardt Llopis, Enric
This work describes two anisotropic optical flow inpainting algorithms. The first one recovers the missing flow values using the Absolutely Minimizing Lipschitz Extension partial differential equation (also called infinity Laplacian equation) and the second one uses the Laplace partial differential equation, both defined on a Riemmanian manifold. The Riemannian manifold is defined by endowing the plane domain with an appropriate metric depending on the reference video frame. A detailed analysis of both approaches is provided and their results are compared on three different applications: flow densification, occlusion inpainting and large hole inpainting.
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Automatic flare spot artifacts detection and removal in photographs

  • Vitoria, Patricia
  • Ballester, Coloma
Flare spot is one type of are artifact caused by a number of conditions, frequently provoked by one or more high-luminance sources within or close to the camera field of view. When light rays coming from a high-luminance source reach the front element of a camera, it can produce intra-reections within camera elements that emerge at the film plane forming non-image information or are on the captured image. Even though preventive mechanisms are used, artifacts can appear. In this paper, we propose a robust computational method to automatically detect and remove are spot artifacts. Our contribution is threefold: firstly, we propose a characterization which is based on intrinsic properties that a are spot is likely to satisfy; secondly, we define a new confidence measure able to select are spots among the candidates; and, finally, a method to accurately determine the are region is given. Then, the detected artifacts are removed by using exemplar-based inpainting. We show that our algorithm achieve top-tier quantitative and qualitative performance., The authors acknowledge partial support by MINECO/FEDER UE project, with reference TIN2015-70410-C2-1-R, and by H2020-MSCA-RISE-2017 project with reference 777826 NoMADS.
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

On anisotropic optical flow inpainting algorithms

  • Raad, Lara
  • Oliver Parera, Maria
  • Ballester, Coloma
  • Haro Ortega, Gloria
  • Meinhardt Llopis, Enric
This work describes two anisotropic optical flow inpainting algorithms. The first one recovers the missing flow values using the Absolutely Minimizing Lipschitz Extension partial differential equation (also called infinity Laplacian equation) and the second one uses the Laplace partial differential equation, both defined on a Riemmanian manifold. The Riemannian manifold is defined by endowing the plane domain with an appropriate metric depending on the reference video frame. A detailed analysis of both approaches is provided and their results are compared on three different applications: flow densification, occlusion inpainting and large hole inpainting.
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

An analysis and speedup of the FALDOI method for Optical Flow estimation

  • Gamonal, Ferran P.
  • Ballester, Coloma
  • Haro Ortega, Gloria
  • Meinhardt Llopis, Enric
  • Palomares, Roberto P.
We present a detailed analysis of FALDOI, a large displacement optical flow method proposed by P. Palomares et al. This method requires a set of discrete matches, which can be extremely sparse, and an energy functional which locally guides the interpolation from the matches. It follows a two-step minimization method at the finest scale which is very robust to the outliers of the sparse matcher and can capture large displacements of small objects. The results shown in the original paper consistently outperformed the coarse-to-fine approaches and achieved good qualitative and quantitative performance on the standard optical flow benchmarks. In this paper we revise the proposed method and the changes done to significantly reduce its execution time while reporting nearly the same accuracy. Finally, we also compare it against the current state-of-the-art to assess its performance., The authors acknowledge support by TIN2015-70410-C2-1-R(MINECO/FEDER, UE) project and by H2020-MSCA-RISE-2017 project, reference 777826 NoMADS.
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

An affine invariant patch similarity

  • Fedorov, Vadim
  • Ballester, Coloma
Image and video comparison is often approached by comparing patches of visual information. In this work we present a detailed description and implementation of an affine invariant patch simi- larity measure that performs an appropriate patch comparison by automatically and intrinsically adapting the size and shape of the patches. We also describe the complete implementation of the proposed iterative algorithm for computation of those shape-adaptive patches around each point in the image domain., The authors acknowledge partial support by MINECO/FEDER UE project, reference TIN2015- 70410-C2-1-R, by GRC reference 2014 SGR 1301 Generalitat de Catalunya, and by H2020-MSCARISE-2017 project, reference 777826 NoMADS.
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Conditioned source separation for musical instrument performances

  • Slizovskaia, Olga
  • Haro Ortega, Gloria
  • Gómez Gutiérrez, Emilia, 1975-
In music source separation, the number of sources may vary for each piece and some of the sources may belong to the same family of instruments, thus sharing timbral characteristics and making the sources more correlated. This leads to additional challenges in the source separation problem. This paper proposes a source separation method for multiple musical instruments sounding simultaneously and explores how much additional information apart from the audio stream can lift the quality of source separation. We explore conditioning techniques at different levels of a primary source separation network and utilize two extra modalities of data, namely presence or absence of instruments in the mixture, and the corresponding video stream data., This work was funded in part by ERC Innovation Programme (grant 770376, TROMPA); Spanish Ministry of Economy and Competitiveness under the Mar´ıa de Maeztu Units of Excellence Program (MDM-2015-0502) and the Social European Funds; the MICINN/FEDER UE project with reference PGC2018-098625-B-I00; and the H2020-MSCARISE-2017 project with reference 777826 NoMADS. We gratefully acknowledge NVIDIA for the donation of GPUs used for the experiments.
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Towards soccer pass feasibility maps: the role of players’ orientation

  • Arbués Sangüesa, Adrià
  • Martin, Adrian
  • Fernández, Javier
  • Haro Ortega, Gloria
  • Ballester, Coloma
Once player tracking has been established as one of the main data sources in soccer, many challenges have emerged for data scientists, who attempt to recognize patterns from 2D trajectories in order to build tools that might help coaches to improve the performance of their teams. For instance, pass models predict where the ball should go next during pass events. However, existing models are mainly fed with players’ location and prior data, hence omitting critical pieces of information such as players’ body orientation. This paper presents a computational model to obtain pass feasibility maps, where player orientation is exploited and analysed. As a matter of fact, orientation proves to be crucial when modelling field-of-view and correct positioning of players, since it limits the potential receiving area of all candidates. Different proposals are given to evaluate the proposed pass feasibility map, reaching 0.46 and 0.79 in Top1 and Top3 accuracy, respectively, with a + 0.2 boost obtained after merging positional data with orientation., This work was supported by MICINN / FEDER UE (Funded by Ministerio de Ciencia, Innovación y Universidades) under Grants PGC2018-098625-B-I00 and FJCI-2017-31758, European Comission, HORIZON 2020 under grant 777826 NoMADS, and Ministerio de Ciencia, Innovación y Universidades (Redes Temáticas de Investigación) under grant RED2018-102511-T.
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Automatic flare spot artifacts detection and removal in photographs

  • Vitoria, Patricia
  • Ballester, Coloma
Flare spot is one type of are artifact caused by a number of conditions, frequently provoked by one or more high-luminance sources within or close to the camera field of view. When light rays coming from a high-luminance source reach the front element of a camera, it can produce intra-reections within camera elements that emerge at the film plane forming non-image information or are on the captured image. Even though preventive mechanisms are used, artifacts can appear. In this paper, we propose a robust computational method to automatically detect and remove are spot artifacts. Our contribution is threefold: firstly, we propose a characterization which is based on intrinsic properties that a are spot is likely to satisfy; secondly, we define a new confidence measure able to select are spots among the candidates; and, finally, a method to accurately determine the are region is given. Then, the detected artifacts are removed by using exemplar-based inpainting. We show that our algorithm achieve top-tier quantitative and qualitative performance., The authors acknowledge partial support by MINECO/FEDER UE project, with reference TIN2015-70410-C2-1-R, and by H2020-MSCA-RISE-2017 project with reference 777826 NoMADS.