Pasar al contenido principal

MODELOS Y TECNICAS COMPUTACIONALES PARA EL ANALISIS Y PROCESAMIENTO DE VIDEO

TIN2015-70410-C2-1-R

•
Nombre agencia financiadora Ministerio de Economía y Competitividad
Acrónimo agencia financiadora MINECO
Programa Programa Estatal de I+D+i Orientado a los Retos de la Sociedad
Convocatoria Proyectos I+D+i Retos de Investigación
Año convocatoria 2015
Plan Estatal 2013-2016 Plan Estatal de Investigación Científica y Técnica y de Innovación
Unidad de gestión Dirección General de Investigación Científica y Técnica
Centro beneficiario UNIVERSITAT POMPEU FABRA CCT
Identificador persistente http://dx.doi.org/10.13039/501100003329

Resultados relacionados

Resultados totales (Incluyendo duplicados): 12
Encontrada(s) 1 página(s)

Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

An affine invariant patch similarity

  • Fedorov, Vadim
  • Ballester, Coloma
Image and video comparison is often approached by comparing patches of visual information. In this work we present a detailed description and implementation of an affine invariant patch simi- larity measure that performs an appropriate patch comparison by automatically and intrinsically adapting the size and shape of the patches. We also describe the complete implementation of the proposed iterative algorithm for computation of those shape-adaptive patches around each point in the image domain., The authors acknowledge partial support by MINECO/FEDER UE project, reference TIN2015- 70410-C2-1-R, by GRC reference 2014 SGR 1301 Generalitat de Catalunya, and by H2020-MSCARISE-2017 project, reference 777826 NoMADS.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

An analysis and speedup of the FALDOI method for Optical Flow estimation

  • Gamonal, Ferran P.
  • Ballester, Coloma
  • Haro Ortega, Gloria
  • Meinhardt Llopis, Enric
  • Palomares, Roberto P.
We present a detailed analysis of FALDOI, a large displacement optical flow method proposed by P. Palomares et al. This method requires a set of discrete matches, which can be extremely sparse, and an energy functional which locally guides the interpolation from the matches. It follows a two-step minimization method at the finest scale which is very robust to the outliers of the sparse matcher and can capture large displacements of small objects. The results shown in the original paper consistently outperformed the coarse-to-fine approaches and achieved good qualitative and quantitative performance on the standard optical flow benchmarks. In this paper we revise the proposed method and the changes done to significantly reduce its execution time while reporting nearly the same accuracy. Finally, we also compare it against the current state-of-the-art to assess its performance., The authors acknowledge support by TIN2015-70410-C2-1-R(MINECO/FEDER, UE) project and by H2020-MSCA-RISE-2017 project, reference 777826 NoMADS.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Joint TV-L1 optical flow and occlusion estimation

  • Garamendi, Juan Francisco
  • Lazcano, Vanel
  • Ballester, Coloma
This document describes an implementation of the energy functional minimization proposed by Ballester, Garrido, Lazcano and Caselles for joint optical flow and occlusion estimation. The method build up from the ideas behind the TV-L1 approach introduced by Zach, Pock and Bischof in 2007 but incorporating information that allows to detect occlusions. This information is based on the divergence of the flow and the proposed energy favors the location of occlusions on regions where this divergence is negative. The implemented variational method uses three consecutive frames. The energy functional is composed of regularization terms using the total variation, a data term using the L1 norm, and a term dealing with the occlusions. In the present implementation, we solve the stationary system of partial differential equations arising from the dual minimization problem associated with the TV operator by a variation of the box relaxation numerical scheme proposed by Garamendi, Gaspar, Malpica and Schiavi. This makes the overall algorithm faster than previous implementations based on a gradient descent method., The first author was partially supported by the Ag`encia de Gestió d’Ajuts Universitaris i de Recerca de la Generalitat de Catalunya within the project PDJ-2014-00038. The first and third authors acknowledge partial support by the MINECO/FEDER project with reference TIN2015- 70410-C2-1-R and by the MICINN project with reference MTM2012-30772.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Affine non-local means image denoising

  • Fedorov, Vadim
  • Ballester, Coloma
This work presents an extension of the Non-Local Means denoising method, that effectively exploits the affine invariant self-similarities present in images of real scenes. Our method provides a better image denoising result by grounding on the fact that in many occasions similar patches exist in the image but have undergone a transformation. The proposal uses an affine invariant patch similarity measure that performs an appropriate patch comparison by automatically and intrinsically adapting the size and shape of the patches. As a result, more similar patches are found and appropriately used. We show that this image denoising method achieves top-tier performance in terms of PSNR, outperforming consistently the results of the regular Non-Local Means, and that it provides state-of-the-art qualitative results., The authors acknowledge partial support by MICINN project, reference MTM2012-30772, by TIN2015-70410-C2- 1-R (MINECO/FEDER, UE), and by GRC reference 2014 SGR 1301, Generalitat de Catalunya.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

FALDOI: a new minimization strategy for large displacement variational optical flow

  • Palomares, Roberto P.
  • Meinhardt Llopis, Enric
  • Ballester, Coloma
  • Haro Ortega, Gloria
We propose a large displacement optical flow method that introduces a new strategy to compute a good local minimum of any optical flow energy functional. The method requires a given set of discrete matches, which can be extremely sparse, and an energy functional which locally guides the interpolation from those matches. In particular, the matches are used to guide a structured coordinate descent of the energy functional around these keypoints. It results in a two-step minimization method at the finest scale which is very robust to the inevitable outliers of the sparse matcher and able to capture large displacements of small objects. Its benefits over other variational methods that also rely on a set of sparse matches are its robustness against very few matches, high levels of noise, and outliers. We validate our proposal using several optical flow variational models. The results consistently outperform the coarse-to-fine approaches and achieve good qualitative and quantitative performance on the standard optical flow benchmarks., The first, second, and third authors acknowledge partial support by MICINN project, reference MTM2012-30772, by TIN2015-70410-C2-1-R (MINECO/FEDER, UE) and by GRC reference 2014 SGR 1301, Generalitat de Catalunya, and the fourth author by the European Research Council (advanced Grant Twelve Labours), Office of Naval research (ONR Grant N00014-14-1-0023).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Automatic flare spot artifacts detection and removal in photographs

  • Vitoria, Patricia
  • Ballester, Coloma
Flare spot is one type of are artifact caused by a number of conditions, frequently provoked by one or more high-luminance sources within or close to the camera field of view. When light rays coming from a high-luminance source reach the front element of a camera, it can produce intra-reections within camera elements that emerge at the film plane forming non-image information or are on the captured image. Even though preventive mechanisms are used, artifacts can appear. In this paper, we propose a robust computational method to automatically detect and remove are spot artifacts. Our contribution is threefold: firstly, we propose a characterization which is based on intrinsic properties that a are spot is likely to satisfy; secondly, we define a new confidence measure able to select are spots among the candidates; and, finally, a method to accurately determine the are region is given. Then, the detected artifacts are removed by using exemplar-based inpainting. We show that our algorithm achieve top-tier quantitative and qualitative performance., The authors acknowledge partial support by MINECO/FEDER UE project, with reference TIN2015-70410-C2-1-R, and by H2020-MSCA-RISE-2017 project with reference 777826 NoMADS.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Joint TV-L1 optical flow and occlusion estimation

  • Garamendi, Juan Francisco
  • Lazcano, Vanel
  • Ballester, Coloma
This document describes an implementation of the energy functional minimization proposed by Ballester, Garrido, Lazcano and Caselles for joint optical flow and occlusion estimation. The method build up from the ideas behind the TV-L1 approach introduced by Zach, Pock and Bischof in 2007 but incorporating information that allows to detect occlusions. This information is based on the divergence of the flow and the proposed energy favors the location of occlusions on regions where this divergence is negative. The implemented variational method uses three consecutive frames. The energy functional is composed of regularization terms using the total variation, a data term using the L1 norm, and a term dealing with the occlusions. In the present implementation, we solve the stationary system of partial differential equations arising from the dual minimization problem associated with the TV operator by a variation of the box relaxation numerical scheme proposed by Garamendi, Gaspar, Malpica and Schiavi. This makes the overall algorithm faster than previous implementations based on a gradient descent method., The first author was partially supported by the Ag`encia de Gestió d’Ajuts Universitaris i de Recerca de la Generalitat de Catalunya within the project PDJ-2014-00038. The first and third authors acknowledge partial support by the MINECO/FEDER project with reference TIN2015- 70410-C2-1-R and by the MICINN project with reference MTM2012-30772.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

FALDOI: a new minimization strategy for large displacement variational optical flow

  • Palomares, Roberto P.
  • Meinhardt Llopis, Enric
  • Ballester, Coloma
  • Haro Ortega, Gloria
We propose a large displacement optical flow method that introduces a new strategy to compute a good local minimum of any optical flow energy functional. The method requires a given set of discrete matches, which can be extremely sparse, and an energy functional which locally guides the interpolation from those matches. In particular, the matches are used to guide a structured coordinate descent of the energy functional around these keypoints. It results in a two-step minimization method at the finest scale which is very robust to the inevitable outliers of the sparse matcher and able to capture large displacements of small objects. Its benefits over other variational methods that also rely on a set of sparse matches are its robustness against very few matches, high levels of noise, and outliers. We validate our proposal using several optical flow variational models. The results consistently outperform the coarse-to-fine approaches and achieve good qualitative and quantitative performance on the standard optical flow benchmarks., The first, second, and third authors acknowledge partial support by MICINN project, reference MTM2012-30772, by TIN2015-70410-C2-1-R (MINECO/FEDER, UE) and by GRC reference 2014 SGR 1301, Generalitat de Catalunya, and the fourth author by the European Research Council (advanced Grant Twelve Labours), Office of Naval research (ONR Grant N00014-14-1-0023).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

An analysis and speedup of the FALDOI method for Optical Flow estimation

  • Gamonal, Ferran P.
  • Ballester, Coloma
  • Haro Ortega, Gloria
  • Meinhardt Llopis, Enric
  • Palomares, Roberto P.
We present a detailed analysis of FALDOI, a large displacement optical flow method proposed by P. Palomares et al. This method requires a set of discrete matches, which can be extremely sparse, and an energy functional which locally guides the interpolation from the matches. It follows a two-step minimization method at the finest scale which is very robust to the outliers of the sparse matcher and can capture large displacements of small objects. The results shown in the original paper consistently outperformed the coarse-to-fine approaches and achieved good qualitative and quantitative performance on the standard optical flow benchmarks. In this paper we revise the proposed method and the changes done to significantly reduce its execution time while reporting nearly the same accuracy. Finally, we also compare it against the current state-of-the-art to assess its performance., The authors acknowledge support by TIN2015-70410-C2-1-R(MINECO/FEDER, UE) project and by H2020-MSCA-RISE-2017 project, reference 777826 NoMADS.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Affine non-local means image denoising

  • Fedorov, Vadim
  • Ballester, Coloma
This work presents an extension of the Non-Local Means denoising method, that effectively exploits the affine invariant self-similarities present in images of real scenes. Our method provides a better image denoising result by grounding on the fact that in many occasions similar patches exist in the image but have undergone a transformation. The proposal uses an affine invariant patch similarity measure that performs an appropriate patch comparison by automatically and intrinsically adapting the size and shape of the patches. As a result, more similar patches are found and appropriately used. We show that this image denoising method achieves top-tier performance in terms of PSNR, outperforming consistently the results of the regular Non-Local Means, and that it provides state-of-the-art qualitative results., The authors acknowledge partial support by MICINN project, reference MTM2012-30772, by TIN2015-70410-C2- 1-R (MINECO/FEDER, UE), and by GRC reference 2014 SGR 1301, Generalitat de Catalunya.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

An affine invariant patch similarity

  • Fedorov, Vadim
  • Ballester, Coloma
Image and video comparison is often approached by comparing patches of visual information. In this work we present a detailed description and implementation of an affine invariant patch simi- larity measure that performs an appropriate patch comparison by automatically and intrinsically adapting the size and shape of the patches. We also describe the complete implementation of the proposed iterative algorithm for computation of those shape-adaptive patches around each point in the image domain., The authors acknowledge partial support by MINECO/FEDER UE project, reference TIN2015- 70410-C2-1-R, by GRC reference 2014 SGR 1301 Generalitat de Catalunya, and by H2020-MSCARISE-2017 project, reference 777826 NoMADS.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Automatic flare spot artifacts detection and removal in photographs

  • Vitoria, Patricia
  • Ballester, Coloma
Flare spot is one type of are artifact caused by a number of conditions, frequently provoked by one or more high-luminance sources within or close to the camera field of view. When light rays coming from a high-luminance source reach the front element of a camera, it can produce intra-reections within camera elements that emerge at the film plane forming non-image information or are on the captured image. Even though preventive mechanisms are used, artifacts can appear. In this paper, we propose a robust computational method to automatically detect and remove are spot artifacts. Our contribution is threefold: firstly, we propose a characterization which is based on intrinsic properties that a are spot is likely to satisfy; secondly, we define a new confidence measure able to select are spots among the candidates; and, finally, a method to accurately determine the are region is given. Then, the detected artifacts are removed by using exemplar-based inpainting. We show that our algorithm achieve top-tier quantitative and qualitative performance., The authors acknowledge partial support by MINECO/FEDER UE project, with reference TIN2015-70410-C2-1-R, and by H2020-MSCA-RISE-2017 project with reference 777826 NoMADS.