Skip to main content

PROCESAMIENTO DE IMAGENES PARA REALCE DE FOTOGRAFIA CINEMATOGRAFICA

TIN2012-38112

•
Funding agency name Ministerio de Economía y Competitividad
Funding agency acronym MINECO
Program Programa Nacional de Proyectos de Investigación Fundamental
Subprogram Subprograma de Proyectos de Investigación Fundamental no Orientada
Call Proyectos I+D
Call year 2012
State Plan 2008-2011 Plan Nacional de Investigación Científica, Desarrollo e Innovación Tecnológica
Management unit Secretaría de Estado de Investigación, Desarrollo e Innovación
Beneficiary centre UNIVERSITAT POMPEU FABRA CCT

Resultados relacionados

Resultados totales (Incluyendo duplicados): 14
Encontrada(s) 1 página(s)

Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Simultaneous blind gamma estimation

  • Vazquez-Corral, Javier
  • Bertalmío, Marcelo
Blind gamma estimation is the problem of estimating the gamma function that is applied to a linear image both for perceptual reasons and for the compensation of the non-linear behavior of displays. Gamma values change both inter- and intra-camera. In the latter case, the change comes from the use of different scene settings. In this letter we propose a new approach that relies on the use of more than a single image from the same scene. We estimate the gammas for all the different images at the same time with a method based on exploiting the structure of the standard in-camera processing pipeline. Our results improve over the state-of-the-art., This work was supported by the European Research Council, Starting Grant ref. 306337, by the Spanish government, grant ref. TIN2012-38112, and by the Icrea Academia Award.
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Spectral sharpening of color sensors: diagonal color constancy and beyond

  • Vazquez-Corral, Javier
  • Bertalmío, Marcelo
It has now been 20 years since the seminal work by Finlayson et al. on the use/nof spectral sharpening of sensors to achieve diagonal color constancy. Spectral sharpening is/nstill used today by numerous researchers for different goals unrelated to the original goal/nof diagonal color constancy e.g., multispectral processing, shadow removal, location of/nunique hues. This paper reviews the idea of spectral sharpening through the lens of what/nis known today in color constancy, describes the different methods used for obtaining a set/nof sharpening sensors and presents an overview of the many different uses that have been/nfound for spectral sharpening over the years., This work was supported by European Research Council, Starting Grant ref. 306337, and by Spanish/ngrants ref. TIN2011-15954-E, and ref. TIN2012-38112
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

A class of nonlocal variational problems on a vector bundle for color image local contrast reduction/enhancement

  • Bertalmío, Marcelo
  • Batard, Thomas
We extend two existing variational models from the Euclidean space to a vector bundle over a Riemannian manifold. The Euclidean models, dedicated to regularize or enhance some color image features, are based on the concept of nonlocal gradient operator acting on a function of the Euclidean space. We then extend these models by generalizing this operator to a vector bundle over a Riemannian manifold with the help of the parallel transport map associated to some class of covariant derivatives. Through the dual formulations of the proposed models, we obtain the expressions of their solutions, which exhibit the functional spaces that describe the image features. Finally, for a well-chosen covariant derivative and its nonlocal extension, the proposed models perform local contrast modification (reduction or enhancement) and experiments show that they preserve more the aspect of the original image than the Euclidean models do while modifying equally its contrast., This work was supported by the European Research Council, Starting Grant ref. 306337, by the Spanish government, grant ref. TIN2012-38112, and by the Icrea Academia Award.
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Color stabilization along time and across shots of the same scene, for one or several cameras of unknown specifications

  • Vazquez-Corral, Javier
  • Bertalmío, Marcelo
We propose a method for color stabilization of shots of the same scene, taken under the same illumination, where one image is chosen as reference and one or several other images are modified so that their colors match those of the reference. We make use of two crucial but often overlooked observations: first, that the core of the color correction chain in a digital camera is simply a multiplication by a 3 × 3 matrix; second, that to color-match a source image to a reference image we do not need to compute their two color correction matrices, it is enough to compute the operation that transforms one matrix into the other. This operation is a 3 × 3 matrix as well, which we call H. Once we have H, we just multiply by it each pixel value of the source and obtain an image which matches in color the reference. To compute H we only require a set of pixel correspondences, we do not need any information about the cameras used, neither models nor specifications or parameter values. We propose an implementation of our framework which is very simple and fast, and show how it can be successfully employed in a number of situations, comparing favorably with the state of the art. There is a wide range of applications of our technique, both for amateur and professional photography and video: color matching for multicamera TV broadcasts, color matching for 3D cinema, color stabilization for amateur video, etc., This work was supported in part by the European Research Council under Grant 306337 and in part by the Spanish Research under Grant TIN2011-15954-E and Grant TIN2012-38112.
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

A decomposition framework for image denoising algorithms

  • Ghimpeteanu, Gabriela
  • Batard, Thomas
  • Bertalmío, Marcelo
  • Levine, Stacey
In this paper, we consider an image decomposition model that provides a novel framework for image denoising. The model computes the components of the image to be processed in a moving frame that encodes its local geometry (directions of gradients and level lines). Then, the strategy we develop is to denoise the components of the image in the moving frame in order to preserve its local geometry, which would have been more affected if processing the image directly. Experiments on a whole image database tested with several denoising methods show that this framework can provide better results than denoising the image directly, both in terms of Peak signal-to-noise ratio and Structural similarity index metrics., The work of G. Ghimpeteanu, T. Batard, and/nM. Bertalmío was supported in part by the Spanish Government under/nGrant TIN2012-38112, in part by the Icrea Academia Award, and in/npart by the European Research Council under Grant 306337. The work/nof S. Levine was supported by the Na/ntional Science Foundation under/nGrant NSF-DMS 1320829.
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

From image processing to computational neuroscience: A neural model based on histogram equalization

  • Bertalmío, Marcelo
There are many ways in which the human visual system works to reduce the inherent redundancy of the visual information in natural scenes, coding it in an efficient way. The non-linear response curves of photoreceptors and the spatial organization of the receptive fields of visual neurons both work toward this goal of efficient coding. A related, very important aspect is that of the existence of post-retinal mechanisms for contrast enhancement that compensate for the blurring produced in early stages of the visual process. And alongside mechanisms for coding and wiring efficiency, there is neural activity in the human visual cortex that correlates with the perceptual phenomenon of lightness induction. In this paper we propose a neural model that is derived from an image processing technique for histogram equalization, and that is able to deal with all the aspects just mentioned: this new model is able to predict lightness induction phenomena, and improves the efficiency of the representation by flattening both the histogram and the power spectrum of the image signal., This work was supported by European Research Council, Starting Grant ref. 306337, by the ICREA Acadèemia Award and by Spanish grants ref. TIN2011-15954-E and ref. TIN2012-38112.
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Perceptual color characterization of cameras

  • Vazquez-Corral, Javier
  • Connah, David
  • Bertalmío, Marcelo
Color camera characterization, mapping outputs from the camera sensors to an/nindependent color space, such as XY Z, is an important step in the camera processing/npipeline. Until now, this procedure has been primarily solved by using a 3 × 3 matrix/nobtained via a least-squares optimization. In this paper, we propose to use the spherical/nsampling method, recently published by Finlayson et al., to perform a perceptual color/ncharacterization. In particular, we search for the 3 × 3 matrix that minimizes three different/nperceptual errors, one pixel based and two spatially based. For the pixel-based case,/nwe minimize the CIE ∆E error, while for the spatial-based case, we minimize both the/nS-CIELAB error and the CID error measure. Our results demonstrate an improvement of/napproximately 3% for the ∆E error, 7% for the S-CIELAB error and 13% for the CID/nerror measures, This work was supported by European Research Council, Starting Grant Ref. 306337, and by Spanish/ngrants AACC, Ref. TIN2011-15954-E, and Plan Nacional, Ref. TIN2012-38112.
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Spectral sharpening of color sensors: diagonal color constancy and beyond

  • Vazquez-Corral, Javier
  • Bertalmío, Marcelo
It has now been 20 years since the seminal work by Finlayson et al. on the use/nof spectral sharpening of sensors to achieve diagonal color constancy. Spectral sharpening is/nstill used today by numerous researchers for different goals unrelated to the original goal/nof diagonal color constancy e.g., multispectral processing, shadow removal, location of/nunique hues. This paper reviews the idea of spectral sharpening through the lens of what/nis known today in color constancy, describes the different methods used for obtaining a set/nof sharpening sensors and presents an overview of the many different uses that have been/nfound for spectral sharpening over the years., This work was supported by European Research Council, Starting Grant ref. 306337, and by Spanish/ngrants ref. TIN2011-15954-E, and ref. TIN2012-38112
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

From image processing to computational neuroscience: A neural model based on histogram equalization

  • Bertalmío, Marcelo
There are many ways in which the human visual system works to reduce the inherent redundancy of the visual information in natural scenes, coding it in an efficient way. The non-linear response curves of photoreceptors and the spatial organization of the receptive fields of visual neurons both work toward this goal of efficient coding. A related, very important aspect is that of the existence of post-retinal mechanisms for contrast enhancement that compensate for the blurring produced in early stages of the visual process. And alongside mechanisms for coding and wiring efficiency, there is neural activity in the human visual cortex that correlates with the perceptual phenomenon of lightness induction. In this paper we propose a neural model that is derived from an image processing technique for histogram equalization, and that is able to deal with all the aspects just mentioned: this new model is able to predict lightness induction phenomena, and improves the efficiency of the representation by flattening both the histogram and the power spectrum of the image signal., This work was supported by European Research Council, Starting Grant ref. 306337, by the ICREA Acadèemia Award and by Spanish grants ref. TIN2011-15954-E and ref. TIN2012-38112.
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

A decomposition framework for image denoising algorithms

  • Ghimpeteanu, Gabriela
  • Batard, Thomas
  • Bertalmío, Marcelo
  • Levine, Stacey
In this paper, we consider an image decomposition model that provides a novel framework for image denoising. The model computes the components of the image to be processed in a moving frame that encodes its local geometry (directions of gradients and level lines). Then, the strategy we develop is to denoise the components of the image in the moving frame in order to preserve its local geometry, which would have been more affected if processing the image directly. Experiments on a whole image database tested with several denoising methods show that this framework can provide better results than denoising the image directly, both in terms of Peak signal-to-noise ratio and Structural similarity index metrics., The work of G. Ghimpeteanu, T. Batard, and/nM. Bertalmío was supported in part by the Spanish Government under/nGrant TIN2012-38112, in part by the Icrea Academia Award, and in/npart by the European Research Council under Grant 306337. The work/nof S. Levine was supported by the Na/ntional Science Foundation under/nGrant NSF-DMS 1320829.
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Simultaneous blind gamma estimation

  • Vazquez-Corral, Javier
  • Bertalmío, Marcelo
Blind gamma estimation is the problem of estimating the gamma function that is applied to a linear image both for perceptual reasons and for the compensation of the non-linear behavior of displays. Gamma values change both inter- and intra-camera. In the latter case, the change comes from the use of different scene settings. In this letter we propose a new approach that relies on the use of more than a single image from the same scene. We estimate the gammas for all the different images at the same time with a method based on exploiting the structure of the standard in-camera processing pipeline. Our results improve over the state-of-the-art., This work was supported by the European Research Council, Starting Grant ref. 306337, by the Spanish government, grant ref. TIN2012-38112, and by the Icrea Academia Award.
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

A class of nonlocal variational problems on a vector bundle for color image local contrast reduction/enhancement

  • Bertalmío, Marcelo
  • Batard, Thomas
We extend two existing variational models from the Euclidean space to a vector bundle over a Riemannian manifold. The Euclidean models, dedicated to regularize or enhance some color image features, are based on the concept of nonlocal gradient operator acting on a function of the Euclidean space. We then extend these models by generalizing this operator to a vector bundle over a Riemannian manifold with the help of the parallel transport map associated to some class of covariant derivatives. Through the dual formulations of the proposed models, we obtain the expressions of their solutions, which exhibit the functional spaces that describe the image features. Finally, for a well-chosen covariant derivative and its nonlocal extension, the proposed models perform local contrast modification (reduction or enhancement) and experiments show that they preserve more the aspect of the original image than the Euclidean models do while modifying equally its contrast., This work was supported by the European Research Council, Starting Grant ref. 306337, by the Spanish government, grant ref. TIN2012-38112, and by the Icrea Academia Award.
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Perceptual color characterization of cameras

  • Vazquez-Corral, Javier
  • Connah, David
  • Bertalmío, Marcelo
Color camera characterization, mapping outputs from the camera sensors to an/nindependent color space, such as XY Z, is an important step in the camera processing/npipeline. Until now, this procedure has been primarily solved by using a 3 × 3 matrix/nobtained via a least-squares optimization. In this paper, we propose to use the spherical/nsampling method, recently published by Finlayson et al., to perform a perceptual color/ncharacterization. In particular, we search for the 3 × 3 matrix that minimizes three different/nperceptual errors, one pixel based and two spatially based. For the pixel-based case,/nwe minimize the CIE ∆E error, while for the spatial-based case, we minimize both the/nS-CIELAB error and the CID error measure. Our results demonstrate an improvement of/napproximately 3% for the ∆E error, 7% for the S-CIELAB error and 13% for the CID/nerror measures, This work was supported by European Research Council, Starting Grant Ref. 306337, and by Spanish/ngrants AACC, Ref. TIN2011-15954-E, and Plan Nacional, Ref. TIN2012-38112.
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Color stabilization along time and across shots of the same scene, for one or several cameras of unknown specifications

  • Vazquez-Corral, Javier
  • Bertalmío, Marcelo
We propose a method for color stabilization of shots of the same scene, taken under the same illumination, where one image is chosen as reference and one or several other images are modified so that their colors match those of the reference. We make use of two crucial but often overlooked observations: first, that the core of the color correction chain in a digital camera is simply a multiplication by a 3 × 3 matrix; second, that to color-match a source image to a reference image we do not need to compute their two color correction matrices, it is enough to compute the operation that transforms one matrix into the other. This operation is a 3 × 3 matrix as well, which we call H. Once we have H, we just multiply by it each pixel value of the source and obtain an image which matches in color the reference. To compute H we only require a set of pixel correspondences, we do not need any information about the cameras used, neither models nor specifications or parameter values. We propose an implementation of our framework which is very simple and fast, and show how it can be successfully employed in a number of situations, comparing favorably with the state of the art. There is a wide range of applications of our technique, both for amateur and professional photography and video: color matching for multicamera TV broadcasts, color matching for 3D cinema, color stabilization for amateur video, etc., This work was supported in part by the European Research Council under Grant 306337 and in part by the Spanish Research under Grant TIN2011-15954-E and Grant TIN2012-38112.