Pasar al contenido principal

MODELOS VARIACIONALES PARA INPAINTING: APLICACION A LA POST-PRODUCCION DE VIDEO

MTM2012-30772

•
Nombre agencia financiadora Ministerio de Economía y Competitividad
Acrónimo agencia financiadora MINECO
Programa Programa Nacional de Proyectos de Investigación Fundamental
Subprograma Subprograma de Proyectos de Investigación Fundamental no Orientada
Convocatoria Proyectos I+D
Año convocatoria 2012
Plan Estatal 2008-2011 Plan Nacional de Investigación Científica, Desarrollo e Innovación Tecnológica
Unidad de gestión Secretaría de Estado de Investigación, Desarrollo e Innovación
Centro beneficiario UNIVERSITAT POMPEU FABRA CCT
Identificador persistente http://dx.doi.org/10.13039/501100003329

Resultados relacionados

Resultados totales (Incluyendo duplicados): 10
Encontrada(s) 1 página(s)

Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

A rotation-invariant regularization term for optical flow related problems

  • Palomares, Roberto P.
  • Haro Ortega, Gloria
  • Ballester, Coloma
Comunicació presentada al 12th Asian Conference on Computer Vision (ACCV 2014), celebrat de l'1 al 5 de novembre de 2014 a Singapur., This paper proposes a new regularization term for optical flow related problems. The proposed regularizer properly handles rotation movements and it also produces good smoothness conditions on the flow field while preserving discontinuities. We also present a dual formulation of the new term that turns the minimization problem into a saddle-point problem that can be solved using a primal-dual algorithm. The performance of the new regularizer has been compared against the Total Variation (TV) in three different problems: optical flow estimation, optical flow inpainting, and optical flow completion from sparse samples. In the three situations the new regularizer improves the results obtained with the TV as a smoothing term., We acknowledge partial support by MICINN project, reference MTM2012-30772, by GRC reference 2009 SGR 773 funded by the Generalitat de Catalunya, and by the ERC Advanced Grant INPAINTING (Grant agreement no.: 319899). The second author acknowledges partial support to the Ramón y Cajal program of the MINECO.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Multiscale analysis of similarities between images on Riemannian manifolds

  • Ballester, Coloma
  • Calderero, Felipe
  • Caselles, Vicente
  • Facciolo Furlan, Gabriele
In this paper we study the problem of comparing two patches of an image defined on a Riemannian manifold, which can be defined by the image domain with a suitable metric depending on the image. The size of the patch will not be determined a priori, and we identify it with a variable scale. Our approach can be considered as a nonlocal extension (comparing two points) of the multiscale analyses defined using the axiomatic approach by Álvarez et al. [Arch. Ration. Mech. Anal., 123 (1993), pp. 199--257]. Following this axiomatic approach, we can define a set of similarity measures that appear as solutions of a degenerate partial differential equation. This equation can be further specified in the linear case, and we observe that it contains as a particular instance the case of using weighted Euclidean distances as comparison measures. Finally, we discuss the case of some morphological scale spaces that exhibit a higher complexity., These authors acknowledge partial support by MICINN project, reference MTM2012-30772, by GRC reference 2009 SGR 773 funded by the Generalitat de Catalunya, and by the ERC Advanced Grant INPAINTING (grant 319899). The third author also acknowledges partial support by the ICREA Acad`emia prize for excellence in research also funded by the Generalitat de Catalunya.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Exemplar-based image inpainting using an affine invariant similarity measure

  • Fedorov, Vadim
  • Arias Martínez, Pablo
  • Facciolo Furlan, Gabriele
  • Ballester, Coloma
Comunicació presentada a 11th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2016), celebrat del 27 al 29 de febrer de 2016 a Roma, Itàlia., Patch-based approaches are used in state-of-the-art methods for image inpainting. This paper presents a new method for exemplar-based image inpainting using transformed patches. The transformation is determined for each patch in a fully automatic way from a surrounding texture content. We build upon a recent affine invariant patch similarity measure that performs an appropriate patch comparison by automatically adapting the size and shape of the patches. As a consequence, it intrinsically extends the set of available source patches to copy information from. We incorporate this measure into a variational formulation for inpainting and present a numerical algorithm for optimizing it. We show that our method can be applied to complete a perspectively distorted texture as well as to automatically inpaint one view of a scene using other view of the same scene as a source. We present experimental results both for gray and color images, and a comparison with some exemplar-based image inpainting methods., The first, second and fourth authors acknowledge partial support by the MINECO/FEDER project with reference TIN2015-70410-C2-1-R , the MICINN project with reference MTM2012- 30772, and by GRC reference 2014 SGR 1301, Generalitat de Catalunya. The second and third authors were partly founded by the Centre National dEtudes Spatiales (CNES, MISS Project), BPIFrance and R´egion Ile de France, in the framework of the FUI 18 Plein Phare project, the European Research Council (advanced grant Twelve Labours n246961), the Office of Naval research (ONR grant N00014-14-1-0023), and ANRDGA project ANR-12-ASTR-0035.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

From occlusion to global depth order, a monocular approach

  • Rezaeirowshan, Babak
  • Ballester, Coloma
  • Haro Ortega, Gloria
Comunicació presentada al 11th International Joint Conference (VISIGRAPP), celebrat del 27 al 29 de febrer de 2016 a Roma, Itàlia., Estimating 3D structure of the scene from a single image remains a challenging problem in computer vision. This paper proposes a novel approach to obtain a global depth order of objects by incorporating monocular perceptual cues such as T-junctions and object boundary convexity, which are local indicators of occlusions, together with physical cues, namely ground contact points. The proposed combination of these local cues complement each other and creates a more thorough partial depth order relationship. The different partial orders are then robustly aggregated using a Markov random chain approximation to obtain the most plausible global depth order. Experiments show that the proposed method excels in comparison to state of the art methods., The authors acknowledge partial support by the MINECO/FEDER project with reference TIN2015-70410-C2-1-R, the MICINN project with reference MTM2012-30772, and by GRC reference 2014 SGR 1301, Generalitat de Catalunya.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Linear multiscale analysis of similarities between images on Riemannian manifolds: practical formula and affine covariant metrics

  • Fedorov, Vadim
  • Arias Martínez, Pablo
  • Sadek, Rida
  • Facciolo Furlan, Gabriele
  • Ballester, Coloma
In this paper we study the problem of comparing two patches of images defined on Riemannian/nmanifolds which in turn can be defined by each image domain with a suitable metric depending on/nthe image. For that we single out one particular instance of a set of models defining image similarities/nthat was earlier studied in [C. Ballester et al., Multiscale Model. Simul., 12 (2014), pp. 616–649],/nusing an axiomatic approach that extended the classical Alvarez–Guichard–Lions–Morel work to the ´/nnonlocal case. Namely, we study a linear model to compare patches defined on two images in RN/nendowed with some metric. Besides its genericity, this linear model is selected by its computational/nfeasibility since it can be approximated leading to an algorithm that has the complexity of the/nusual patch comparison using a weighted Euclidean distance. Moreover, we propose and study some/nintrinsic metrics which we define in terms of affine covariant structure tensors and we discuss their/nproperties. These tensors are defined for any point in the image and are intrinsically endowed with/naffine covariant neighborhoods. We also discuss the effect of discretization over the affine covariance/nproperties of the tensors. We illustrate our theoretical results with numerical experiments., The research of these authors was partially supported by MICINN project MTM2012-30772, by the ERC Advanced Grant INPAINTING (grant agreement 319899), and by GRC reference 2014 SGR 1301, Generalitat de Catalunya.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Multiscale analysis of similarities between images on Riemannian manifolds

  • Ballester, Coloma
  • Calderero, Felipe
  • Caselles, Vicente
  • Facciolo Furlan, Gabriele
In this paper we study the problem of comparing two patches of an image defined on a Riemannian manifold, which can be defined by the image domain with a suitable metric depending on the image. The size of the patch will not be determined a priori, and we identify it with a variable scale. Our approach can be considered as a nonlocal extension (comparing two points) of the multiscale analyses defined using the axiomatic approach by Álvarez et al. [Arch. Ration. Mech. Anal., 123 (1993), pp. 199--257]. Following this axiomatic approach, we can define a set of similarity measures that appear as solutions of a degenerate partial differential equation. This equation can be further specified in the linear case, and we observe that it contains as a particular instance the case of using weighted Euclidean distances as comparison measures. Finally, we discuss the case of some morphological scale spaces that exhibit a higher complexity., These authors acknowledge partial support by MICINN project, reference MTM2012-30772, by GRC reference 2009 SGR 773 funded by the Generalitat de Catalunya, and by the ERC Advanced Grant INPAINTING (grant 319899). The third author also acknowledges partial support by the ICREA Acad`emia prize for excellence in research also funded by the Generalitat de Catalunya.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Exemplar-based image inpainting using an affine invariant similarity measure

  • Fedorov, Vadim
  • Arias Martínez, Pablo
  • Facciolo Furlan, Gabriele
  • Ballester, Coloma
Comunicació presentada a 11th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2016), celebrat del 27 al 29 de febrer de 2016 a Roma, Itàlia., Patch-based approaches are used in state-of-the-art methods for image inpainting. This paper presents a new method for exemplar-based image inpainting using transformed patches. The transformation is determined for each patch in a fully automatic way from a surrounding texture content. We build upon a recent affine invariant patch similarity measure that performs an appropriate patch comparison by automatically adapting the size and shape of the patches. As a consequence, it intrinsically extends the set of available source patches to copy information from. We incorporate this measure into a variational formulation for inpainting and present a numerical algorithm for optimizing it. We show that our method can be applied to complete a perspectively distorted texture as well as to automatically inpaint one view of a scene using other view of the same scene as a source. We present experimental results both for gray and color images, and a comparison with some exemplar-based image inpainting methods., The first, second and fourth authors acknowledge partial support by the MINECO/FEDER project with reference TIN2015-70410-C2-1-R , the MICINN project with reference MTM2012- 30772, and by GRC reference 2014 SGR 1301, Generalitat de Catalunya. The second and third authors were partly founded by the Centre National dEtudes Spatiales (CNES, MISS Project), BPIFrance and R´egion Ile de France, in the framework of the FUI 18 Plein Phare project, the European Research Council (advanced grant Twelve Labours n246961), the Office of Naval research (ONR grant N00014-14-1-0023), and ANRDGA project ANR-12-ASTR-0035.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

From occlusion to global depth order, a monocular approach

  • Rezaeirowshan, Babak
  • Ballester, Coloma
  • Haro Ortega, Gloria
Comunicació presentada al 11th International Joint Conference (VISIGRAPP), celebrat del 27 al 29 de febrer de 2016 a Roma, Itàlia., Estimating 3D structure of the scene from a single image remains a challenging problem in computer vision. This paper proposes a novel approach to obtain a global depth order of objects by incorporating monocular perceptual cues such as T-junctions and object boundary convexity, which are local indicators of occlusions, together with physical cues, namely ground contact points. The proposed combination of these local cues complement each other and creates a more thorough partial depth order relationship. The different partial orders are then robustly aggregated using a Markov random chain approximation to obtain the most plausible global depth order. Experiments show that the proposed method excels in comparison to state of the art methods., The authors acknowledge partial support by the MINECO/FEDER project with reference TIN2015-70410-C2-1-R, the MICINN project with reference MTM2012-30772, and by GRC reference 2014 SGR 1301, Generalitat de Catalunya.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Linear multiscale analysis of similarities between images on Riemannian manifolds: practical formula and affine covariant metrics

  • Fedorov, Vadim
  • Arias Martínez, Pablo
  • Sadek, Rida
  • Facciolo Furlan, Gabriele
  • Ballester, Coloma
In this paper we study the problem of comparing two patches of images defined on Riemannian/nmanifolds which in turn can be defined by each image domain with a suitable metric depending on/nthe image. For that we single out one particular instance of a set of models defining image similarities/nthat was earlier studied in [C. Ballester et al., Multiscale Model. Simul., 12 (2014), pp. 616–649],/nusing an axiomatic approach that extended the classical Alvarez–Guichard–Lions–Morel work to the ´/nnonlocal case. Namely, we study a linear model to compare patches defined on two images in RN/nendowed with some metric. Besides its genericity, this linear model is selected by its computational/nfeasibility since it can be approximated leading to an algorithm that has the complexity of the/nusual patch comparison using a weighted Euclidean distance. Moreover, we propose and study some/nintrinsic metrics which we define in terms of affine covariant structure tensors and we discuss their/nproperties. These tensors are defined for any point in the image and are intrinsically endowed with/naffine covariant neighborhoods. We also discuss the effect of discretization over the affine covariance/nproperties of the tensors. We illustrate our theoretical results with numerical experiments., The research of these authors was partially supported by MICINN project MTM2012-30772, by the ERC Advanced Grant INPAINTING (grant agreement 319899), and by GRC reference 2014 SGR 1301, Generalitat de Catalunya.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

A rotation-invariant regularization term for optical flow related problems

  • Palomares, Roberto P.
  • Haro Ortega, Gloria
  • Ballester, Coloma
Comunicació presentada al 12th Asian Conference on Computer Vision (ACCV 2014), celebrat de l'1 al 5 de novembre de 2014 a Singapur., This paper proposes a new regularization term for optical flow related problems. The proposed regularizer properly handles rotation movements and it also produces good smoothness conditions on the flow field while preserving discontinuities. We also present a dual formulation of the new term that turns the minimization problem into a saddle-point problem that can be solved using a primal-dual algorithm. The performance of the new regularizer has been compared against the Total Variation (TV) in three different problems: optical flow estimation, optical flow inpainting, and optical flow completion from sparse samples. In the three situations the new regularizer improves the results obtained with the TV as a smoothing term., We acknowledge partial support by MICINN project, reference MTM2012-30772, by GRC reference 2009 SGR 773 funded by the Generalitat de Catalunya, and by the ERC Advanced Grant INPAINTING (Grant agreement no.: 319899). The second author acknowledges partial support to the Ramón y Cajal program of the MINECO.