Skip to main content

Resultados relacionados

Resultados totales (Incluyendo duplicados): 12
Encontrada(s) 1 página(s)

Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Spectral sharpening of color sensors: diagonal color constancy and beyond

  • Vazquez-Corral, Javier
  • Bertalmío, Marcelo
It has now been 20 years since the seminal work by Finlayson et al. on the use/nof spectral sharpening of sensors to achieve diagonal color constancy. Spectral sharpening is/nstill used today by numerous researchers for different goals unrelated to the original goal/nof diagonal color constancy e.g., multispectral processing, shadow removal, location of/nunique hues. This paper reviews the idea of spectral sharpening through the lens of what/nis known today in color constancy, describes the different methods used for obtaining a set/nof sharpening sensors and presents an overview of the many different uses that have been/nfound for spectral sharpening over the years., This work was supported by European Research Council, Starting Grant ref. 306337, and by Spanish/ngrants ref. TIN2011-15954-E, and ref. TIN2012-38112
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Color stabilization along time and across shots of the same scene, for one or several cameras of unknown specifications

  • Vazquez-Corral, Javier
  • Bertalmío, Marcelo
We propose a method for color stabilization of shots of the same scene, taken under the same illumination, where one image is chosen as reference and one or several other images are modified so that their colors match those of the reference. We make use of two crucial but often overlooked observations: first, that the core of the color correction chain in a digital camera is simply a multiplication by a 3 × 3 matrix; second, that to color-match a source image to a reference image we do not need to compute their two color correction matrices, it is enough to compute the operation that transforms one matrix into the other. This operation is a 3 × 3 matrix as well, which we call H. Once we have H, we just multiply by it each pixel value of the source and obtain an image which matches in color the reference. To compute H we only require a set of pixel correspondences, we do not need any information about the cameras used, neither models nor specifications or parameter values. We propose an implementation of our framework which is very simple and fast, and show how it can be successfully employed in a number of situations, comparing favorably with the state of the art. There is a wide range of applications of our technique, both for amateur and professional photography and video: color matching for multicamera TV broadcasts, color matching for 3D cinema, color stabilization for amateur video, etc., This work was supported in part by the European Research Council under Grant 306337 and in part by the Spanish Research under Grant TIN2011-15954-E and Grant TIN2012-38112.
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Variational approach for the fusion of exposure bracketed pairs

  • Bertalmío, Marcelo
  • Levine, Stacey
When taking pictures of a dark scene with artificial lighting, ambient light is not sufficient for most cameras to obtain both accurate color and detail information. The exposure bracketing feature usually available in many camera models enables the user to obtain a series of pictures taken in rapid succession with different exposure times; the implicit idea is that the user picks the best image from this set. But in many cases, none of these images is good enough; in general, good brightness and color information are retained from longer-exposure settings, whereas sharp details are obtained from shorter ones. In this paper, we propose a variational method for automatically combining an exposure-bracketed pair of images within a single picture that reflects the desired properties of each one. We introduce an energy functional consisting of two terms, one measuring the difference in edge information with the short-exposure image and the other measuring the local color difference with a warped version of the long-exposure image. This method is able to handle camera and subject motion as well as noise, and the results compare favorably with the state of the art., The first author acknowledges partial support by AACC project, reference TIN2011-15954-E, and by the ERC Starting Grant “Image Processing for Enhanced Cinematography.” The second author is funded in part by NSF-DMS #0915219.
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

From image processing to computational neuroscience: A neural model based on histogram equalization

  • Bertalmío, Marcelo
There are many ways in which the human visual system works to reduce the inherent redundancy of the visual information in natural scenes, coding it in an efficient way. The non-linear response curves of photoreceptors and the spatial organization of the receptive fields of visual neurons both work toward this goal of efficient coding. A related, very important aspect is that of the existence of post-retinal mechanisms for contrast enhancement that compensate for the blurring produced in early stages of the visual process. And alongside mechanisms for coding and wiring efficiency, there is neural activity in the human visual cortex that correlates with the perceptual phenomenon of lightness induction. In this paper we propose a neural model that is derived from an image processing technique for histogram equalization, and that is able to deal with all the aspects just mentioned: this new model is able to predict lightness induction phenomena, and improves the efficiency of the representation by flattening both the histogram and the power spectrum of the image signal., This work was supported by European Research Council, Starting Grant ref. 306337, by the ICREA Acadèemia Award and by Spanish grants ref. TIN2011-15954-E and ref. TIN2012-38112.
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Perceptual color characterization of cameras

  • Vazquez-Corral, Javier
  • Connah, David
  • Bertalmío, Marcelo
Color camera characterization, mapping outputs from the camera sensors to an/nindependent color space, such as XY Z, is an important step in the camera processing/npipeline. Until now, this procedure has been primarily solved by using a 3 × 3 matrix/nobtained via a least-squares optimization. In this paper, we propose to use the spherical/nsampling method, recently published by Finlayson et al., to perform a perceptual color/ncharacterization. In particular, we search for the 3 × 3 matrix that minimizes three different/nperceptual errors, one pixel based and two spatially based. For the pixel-based case,/nwe minimize the CIE ∆E error, while for the spatial-based case, we minimize both the/nS-CIELAB error and the CID error measure. Our results demonstrate an improvement of/napproximately 3% for the ∆E error, 7% for the S-CIELAB error and 13% for the CID/nerror measures, This work was supported by European Research Council, Starting Grant Ref. 306337, and by Spanish/ngrants AACC, Ref. TIN2011-15954-E, and Plan Nacional, Ref. TIN2012-38112.
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

A nonlocal variational formulation for the improvement of tone mapped images

  • Cyriac, Praveen
  • Batard, Thomas
  • Bertalmío, Marcelo
Due to technical limitations, common display devices can only reproduce images having a low range of intensity values (dynamic range). As a consequence, the dynamic range of images encoding real world scenes, which is large, has to be compressed in order for them to be reproduced on a common display, and this technique is called tone mapping. Because there is no ground truth to compare with, evaluation of a tone mapped image has to be done by comparing with the original high dynamic range image. As standard metrics based on pixel-wise comparisons are not suitable for comparing images of different dynamic range, non local perceptual based metrics are commonly used. We propose a general method for optimizing tone mapped images with respect to a given non local metric. In particular, if the metric is perceptual, i.e. it involves perceptual concepts, we provide an adequate minimization strategy. Experiments on a particular perceptual metric tested with different tone mapped images provided by several tone mapping operators validate our approach., This work was supported by European Research Council, Starting Grant ref. 306337, and by Spanish grants ref. TIN2011-15954-E and ref. TIN2012-38112.
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Spectral sharpening of color sensors: diagonal color constancy and beyond

  • Vazquez-Corral, Javier
  • Bertalmío, Marcelo
It has now been 20 years since the seminal work by Finlayson et al. on the use/nof spectral sharpening of sensors to achieve diagonal color constancy. Spectral sharpening is/nstill used today by numerous researchers for different goals unrelated to the original goal/nof diagonal color constancy e.g., multispectral processing, shadow removal, location of/nunique hues. This paper reviews the idea of spectral sharpening through the lens of what/nis known today in color constancy, describes the different methods used for obtaining a set/nof sharpening sensors and presents an overview of the many different uses that have been/nfound for spectral sharpening over the years., This work was supported by European Research Council, Starting Grant ref. 306337, and by Spanish/ngrants ref. TIN2011-15954-E, and ref. TIN2012-38112
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

From image processing to computational neuroscience: A neural model based on histogram equalization

  • Bertalmío, Marcelo
There are many ways in which the human visual system works to reduce the inherent redundancy of the visual information in natural scenes, coding it in an efficient way. The non-linear response curves of photoreceptors and the spatial organization of the receptive fields of visual neurons both work toward this goal of efficient coding. A related, very important aspect is that of the existence of post-retinal mechanisms for contrast enhancement that compensate for the blurring produced in early stages of the visual process. And alongside mechanisms for coding and wiring efficiency, there is neural activity in the human visual cortex that correlates with the perceptual phenomenon of lightness induction. In this paper we propose a neural model that is derived from an image processing technique for histogram equalization, and that is able to deal with all the aspects just mentioned: this new model is able to predict lightness induction phenomena, and improves the efficiency of the representation by flattening both the histogram and the power spectrum of the image signal., This work was supported by European Research Council, Starting Grant ref. 306337, by the ICREA Acadèemia Award and by Spanish grants ref. TIN2011-15954-E and ref. TIN2012-38112.
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

A nonlocal variational formulation for the improvement of tone mapped images

  • Cyriac, Praveen
  • Batard, Thomas
  • Bertalmío, Marcelo
Due to technical limitations, common display devices can only reproduce images having a low range of intensity values (dynamic range). As a consequence, the dynamic range of images encoding real world scenes, which is large, has to be compressed in order for them to be reproduced on a common display, and this technique is called tone mapping. Because there is no ground truth to compare with, evaluation of a tone mapped image has to be done by comparing with the original high dynamic range image. As standard metrics based on pixel-wise comparisons are not suitable for comparing images of different dynamic range, non local perceptual based metrics are commonly used. We propose a general method for optimizing tone mapped images with respect to a given non local metric. In particular, if the metric is perceptual, i.e. it involves perceptual concepts, we provide an adequate minimization strategy. Experiments on a particular perceptual metric tested with different tone mapped images provided by several tone mapping operators validate our approach., This work was supported by European Research Council, Starting Grant ref. 306337, and by Spanish grants ref. TIN2011-15954-E and ref. TIN2012-38112.
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Perceptual color characterization of cameras

  • Vazquez-Corral, Javier
  • Connah, David
  • Bertalmío, Marcelo
Color camera characterization, mapping outputs from the camera sensors to an/nindependent color space, such as XY Z, is an important step in the camera processing/npipeline. Until now, this procedure has been primarily solved by using a 3 × 3 matrix/nobtained via a least-squares optimization. In this paper, we propose to use the spherical/nsampling method, recently published by Finlayson et al., to perform a perceptual color/ncharacterization. In particular, we search for the 3 × 3 matrix that minimizes three different/nperceptual errors, one pixel based and two spatially based. For the pixel-based case,/nwe minimize the CIE ∆E error, while for the spatial-based case, we minimize both the/nS-CIELAB error and the CID error measure. Our results demonstrate an improvement of/napproximately 3% for the ∆E error, 7% for the S-CIELAB error and 13% for the CID/nerror measures, This work was supported by European Research Council, Starting Grant Ref. 306337, and by Spanish/ngrants AACC, Ref. TIN2011-15954-E, and Plan Nacional, Ref. TIN2012-38112.
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Variational approach for the fusion of exposure bracketed pairs

  • Bertalmío, Marcelo
  • Levine, Stacey
When taking pictures of a dark scene with artificial lighting, ambient light is not sufficient for most cameras to obtain both accurate color and detail information. The exposure bracketing feature usually available in many camera models enables the user to obtain a series of pictures taken in rapid succession with different exposure times; the implicit idea is that the user picks the best image from this set. But in many cases, none of these images is good enough; in general, good brightness and color information are retained from longer-exposure settings, whereas sharp details are obtained from shorter ones. In this paper, we propose a variational method for automatically combining an exposure-bracketed pair of images within a single picture that reflects the desired properties of each one. We introduce an energy functional consisting of two terms, one measuring the difference in edge information with the short-exposure image and the other measuring the local color difference with a warped version of the long-exposure image. This method is able to handle camera and subject motion as well as noise, and the results compare favorably with the state of the art., The first author acknowledges partial support by AACC project, reference TIN2011-15954-E, and by the ERC Starting Grant “Image Processing for Enhanced Cinematography.” The second author is funded in part by NSF-DMS #0915219.
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Color stabilization along time and across shots of the same scene, for one or several cameras of unknown specifications

  • Vazquez-Corral, Javier
  • Bertalmío, Marcelo
We propose a method for color stabilization of shots of the same scene, taken under the same illumination, where one image is chosen as reference and one or several other images are modified so that their colors match those of the reference. We make use of two crucial but often overlooked observations: first, that the core of the color correction chain in a digital camera is simply a multiplication by a 3 × 3 matrix; second, that to color-match a source image to a reference image we do not need to compute their two color correction matrices, it is enough to compute the operation that transforms one matrix into the other. This operation is a 3 × 3 matrix as well, which we call H. Once we have H, we just multiply by it each pixel value of the source and obtain an image which matches in color the reference. To compute H we only require a set of pixel correspondences, we do not need any information about the cameras used, neither models nor specifications or parameter values. We propose an implementation of our framework which is very simple and fast, and show how it can be successfully employed in a number of situations, comparing favorably with the state of the art. There is a wide range of applications of our technique, both for amateur and professional photography and video: color matching for multicamera TV broadcasts, color matching for 3D cinema, color stabilization for amateur video, etc., This work was supported in part by the European Research Council under Grant 306337 and in part by the Spanish Research under Grant TIN2011-15954-E and Grant TIN2012-38112.