Pasar al contenido principal

Resultados relacionados

Resultados totales (Incluyendo duplicados): 18
Encontrada(s) 1 página(s)

Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Color stabilization along time and across shots of the same scene, for one or several cameras of unknown specifications

  • Vazquez-Corral, Javier
  • Bertalmío, Marcelo
We propose a method for color stabilization of shots of the same scene, taken under the same illumination, where one image is chosen as reference and one or several other images are modified so that their colors match those of the reference. We make use of two crucial but often overlooked observations: first, that the core of the color correction chain in a digital camera is simply a multiplication by a 3 × 3 matrix; second, that to color-match a source image to a reference image we do not need to compute their two color correction matrices, it is enough to compute the operation that transforms one matrix into the other. This operation is a 3 × 3 matrix as well, which we call H. Once we have H, we just multiply by it each pixel value of the source and obtain an image which matches in color the reference. To compute H we only require a set of pixel correspondences, we do not need any information about the cameras used, neither models nor specifications or parameter values. We propose an implementation of our framework which is very simple and fast, and show how it can be successfully employed in a number of situations, comparing favorably with the state of the art. There is a wide range of applications of our technique, both for amateur and professional photography and video: color matching for multicamera TV broadcasts, color matching for 3D cinema, color stabilization for amateur video, etc., This work was supported in part by the European Research Council under Grant 306337 and in part by the Spanish Research under Grant TIN2011-15954-E and Grant TIN2012-38112.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Gamut mapping through perceptually-based contrast reduction

  • Bertalmío, Marcelo
  • Zamir, Syed Waqas
  • Vazquez-Corral, Javier
Comunicació presentada a: 6th Pacific-Rim Symposium on Image and Video Technology, (PSIVT 2013), celebrada del 28 d'octubre a l'1 de novembre a Guanajuato, Mèxic., In this paper we present a spatial gamut mapping algorithm that relies on a perceptually-based variational framework. Our method adapts a well-known image energy functional whose minimization leads to image enhancement and contrast modification. We show how by varying the importance of the contrast term in the image functional we are able to perform gamut reduction. We propose an iterative scheme that allows our algorithm to successfully map the colors from the gamut of the original image to a given destination gamut while preserving the colors’ perception and texture close to the original image. Both subjective and objective evaluation validate the promising results achieved via our proposed framework., This work was supported by the European Research Council, Starting Grant ref. 306337, and by Spanish grants ref. TIN2011-15954-E and ref. TIN2012-38112.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Variational approach for the fusion of exposure bracketed pairs

  • Bertalmío, Marcelo
  • Levine, Stacey
When taking pictures of a dark scene with artificial lighting, ambient light is not sufficient for most cameras to obtain both accurate color and detail information. The exposure bracketing feature usually available in many camera models enables the user to obtain a series of pictures taken in rapid succession with different exposure times; the implicit idea is that the user picks the best image from this set. But in many cases, none of these images is good enough; in general, good brightness and color information are retained from longer-exposure settings, whereas sharp details are obtained from shorter ones. In this paper, we propose a variational method for automatically combining an exposure-bracketed pair of images within a single picture that reflects the desired properties of each one. We introduce an energy functional consisting of two terms, one measuring the difference in edge information with the short-exposure image and the other measuring the local color difference with a warped version of the long-exposure image. This method is able to handle camera and subject motion as well as noise, and the results compare favorably with the state of the art., The first author acknowledges partial support by AACC project, reference TIN2011-15954-E, and by the ERC Starting Grant “Image Processing for Enhanced Cinematography.” The second author is funded in part by NSF-DMS #0915219.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Color matching for stereoscopic cinema

  • Bertalmío, Marcelo
  • Levine, Stacey
In a stereo camera set-up for 3D cinema, much care is taken to ensure/nthat the cameras are both the same model and use identical/nparameter values. But an imperfect adjustment, the use of beam/nsplitters, as well as unavoidable differences in the characteristics/nof the cameras and lens systems, often cause visible differences in/ncolor among the two views. Many of these differences appear to/nbe local and therefore cannot be fully removed by common color/nmatching approaches, which are typically global methods. We propose/na simple yet effective method for local color matching, that/noperates in three steps. First, one view is chosen as the target and/nmorphed so that it becomes locally registered with the source view,/nthe one whose colors will be modified. Next, color matching is performed/non the source view by aligning each local histogram with/nthe corresponding local histogram in the warped target view. Finally,/nPoisson editing [9] is applied on the source regions which/nhave no correspondence in the target. For several professional, high/nquality examples of 3D sequences, we show that our algorithm outperforms/nfour different conventional color matching approaches., We would like to thank Pierre Jasmin of RE:Vision Effects Inc./nfor his unwavering support and his help running tests, and Clark/nDunbar of Mammoth HD Inc. for supplying us with professional/n3D footage. M. Bertalmío acknowledges support by European Research/nCouncil, Starting Grant ref. 306337, and Spanish grants AACC, ref. TIN2011-15954-E, and Plan Nacional, ref. TIN2012-/n38112. S. Levine is funded in part by NSF-DMS #0915219.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

A variational method for the optimization of tone mapping operators

  • Cyriac, Praveen
  • Batard, Thomas
  • Bertalmío, Marcelo
Comunicació presentada a: 6th Pacific-Rim Symposium on Image and Video Technology, celebrat del 28 d'octubre a 1 de novembre de 2013 a Guanajuato, Mèxic., Given any metric that compares images of di erent dynamic range, we propose a method to reduce their distance with respect to this metric. The key idea is to consider the metric as a non local operator. Then, we transform the problem of distance reduction into a non local variational problem. In this context, the low dynamic range image having the smallest distance with a given high dynamic range is the minimum of a suitable energy, and can be reached through a gradient descent algorithm. Dealing with an appropriate metric, we present an application to Tone Mapping Operator (TMO) optimization. We apply our gradient descent algorithm, where the initial conditions are Tone Mapped (TM) images. Experiments show that our algorithm does reduce the distance of the TM images with the high dynamic range source images, meaning that our method improves the corresponding TMOs., This work was supported by the European Research Council, Starting Grant ref. 306337, and by Spanish grants ref. TIN2011-15954-E and ref. TIN2012-38112.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Denoising an image by denoising its components in a moving frame

  • Ghimpeteanu, Gabriela
  • Batard, Thomas
  • Bertalmío, Marcelo
  • Levine, Stacey
Comunicació presentada a: the 6th International Conference, (ICISP 2014), celebrada del 30. de juny al 2 de juliol de 2014 a Cherbourg, França., In this paper, we provide a new non-local method for image denoising. The key idea we develop is to denoise the components of the image in a well-chosen moving frame instead of the image itself.We prove the relevance of our approach by showing that the PSNR of a grayscale noisy image is lower than the PSNR of its components. Experiments show that applying the Non Local Means algorithm of Buades et al. on the components provides better results than applying it directly on the image., This work was supported by European Research Council, Starting Grant ref. 306337, and by Spanish grants AACC, ref. TIN2011-15954-E, and Plan Na- cional, ref. TIN2012-38112. S. Levine acknowledges partial support by NSF-DMS #0915219.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

A variational framework for single image dehazing

  • Galdran, Adrian
  • Vazquez-Corral, Javier
  • Pardo, David
  • Bertalmío, Marcelo
Comunicació presentada a: European Conference on Computer Vision Workshops (ECCV 2014), celebrada del 6 al 7 de setembre de 2014 a Zurich, Suïssa., Images captured under adverse weather conditions, such as haze or fog, typically exhibit low contrast and faded colors, which may severely limit the visibility within the scene. Unveiling the image struc- ture under the haze layer and recovering vivid colors out of a single image remains a challenging task, since the degradation is depth-dependent and conventional methods are unable to handle this problem. We propose to extend a well-known perception-inspired variational frame- work [1] for the task of single image dehazing. The main modification consists on the replacement of the value used by this framework for the grey-world hypothesis by an estimation of the mean of the clean image. This allows us to devise a variational method that requires no estimate of the depth structure of the scene, performing a spatially-variant contrast enhancement that effectively removes haze from far away regions. Experimental results show that our method competes well with other state- of-the-art methods in typical benchmark images, while outperforming current image dehazing methods in more challenging scenarios., JVC and MB were supported by European Research Council, Starting Grant ref. 306337, and by Spanish grants ref. TIN2011-15954-E and ref. TIN2012-38112.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

A nonlocal variational formulation for the improvement of tone mapped images

  • Cyriac, Praveen
  • Batard, Thomas
  • Bertalmío, Marcelo
Due to technical limitations, common display devices can only reproduce images having a low range of intensity values (dynamic range). As a consequence, the dynamic range of images encoding real world scenes, which is large, has to be compressed in order for them to be reproduced on a common display, and this technique is called tone mapping. Because there is no ground truth to compare with, evaluation of a tone mapped image has to be done by comparing with the original high dynamic range image. As standard metrics based on pixel-wise comparisons are not suitable for comparing images of different dynamic range, non local perceptual based metrics are commonly used. We propose a general method for optimizing tone mapped images with respect to a given non local metric. In particular, if the metric is perceptual, i.e. it involves perceptual concepts, we provide an adequate minimization strategy. Experiments on a particular perceptual metric tested with different tone mapped images provided by several tone mapping operators validate our approach., This work was supported by European Research Council, Starting Grant ref. 306337, and by Spanish grants ref. TIN2011-15954-E and ref. TIN2012-38112.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Harmonic flow for histogram matching

  • Batard, Thomas
  • Bertalmío, Marcelo
Comunicació presentada a: 6th Pacific-Rim Symposium on Image and Video Technology Workshop, celebrat del 28-29 d'octubre de 2013 a Guanajuato, Mèxic., We present a method to perform histogram matching be- tween two color images based on the concept of harmonic mapping be- tween Riemannian manifolds. The key idea is to associate the histogram of a color image to a Riemannian manifold. In this context, the energy of the matching between the two images is measured by the Dirichlet energy of the mapping between the Riemannian manifolds. Then, we assimilate optimal matchings to critical points of the Dirichlet energy. Such points are called harmonic maps. As there is no explicit expression for harmonic maps in general, we use a gradient descent ow with boundary condition to reach them, that we call harmonic ow. We present an application to color transfer, however many others applications can be envisaged using this general framework., This work was supported by European Research Council, Starting Grant ref. 306337. The second author acknowledges partial support by Spanish grants AACC, ref. TIN2011-15954-E, and Plan Nacional, ref. TIN2012-38112.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Gamut mapping through perceptually-based contrast reduction

  • Bertalmío, Marcelo
  • Zamir, Syed Waqas
  • Vazquez-Corral, Javier
Comunicació presentada a: 6th Pacific-Rim Symposium on Image and Video Technology, (PSIVT 2013), celebrada del 28 d'octubre a l'1 de novembre a Guanajuato, Mèxic., In this paper we present a spatial gamut mapping algorithm that relies on a perceptually-based variational framework. Our method adapts a well-known image energy functional whose minimization leads to image enhancement and contrast modification. We show how by varying the importance of the contrast term in the image functional we are able to perform gamut reduction. We propose an iterative scheme that allows our algorithm to successfully map the colors from the gamut of the original image to a given destination gamut while preserving the colors’ perception and texture close to the original image. Both subjective and objective evaluation validate the promising results achieved via our proposed framework., This work was supported by the European Research Council, Starting Grant ref. 306337, and by Spanish grants ref. TIN2011-15954-E and ref. TIN2012-38112.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

A variational method for the optimization of tone mapping operators

  • Cyriac, Praveen
  • Batard, Thomas
  • Bertalmío, Marcelo
Comunicació presentada a: 6th Pacific-Rim Symposium on Image and Video Technology, celebrat del 28 d'octubre a 1 de novembre de 2013 a Guanajuato, Mèxic., Given any metric that compares images of di erent dynamic range, we propose a method to reduce their distance with respect to this metric. The key idea is to consider the metric as a non local operator. Then, we transform the problem of distance reduction into a non local variational problem. In this context, the low dynamic range image having the smallest distance with a given high dynamic range is the minimum of a suitable energy, and can be reached through a gradient descent algorithm. Dealing with an appropriate metric, we present an application to Tone Mapping Operator (TMO) optimization. We apply our gradient descent algorithm, where the initial conditions are Tone Mapped (TM) images. Experiments show that our algorithm does reduce the distance of the TM images with the high dynamic range source images, meaning that our method improves the corresponding TMOs., This work was supported by the European Research Council, Starting Grant ref. 306337, and by Spanish grants ref. TIN2011-15954-E and ref. TIN2012-38112.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Harmonic flow for histogram matching

  • Batard, Thomas
  • Bertalmío, Marcelo
Comunicació presentada a: 6th Pacific-Rim Symposium on Image and Video Technology Workshop, celebrat del 28-29 d'octubre de 2013 a Guanajuato, Mèxic., We present a method to perform histogram matching be- tween two color images based on the concept of harmonic mapping be- tween Riemannian manifolds. The key idea is to associate the histogram of a color image to a Riemannian manifold. In this context, the energy of the matching between the two images is measured by the Dirichlet energy of the mapping between the Riemannian manifolds. Then, we assimilate optimal matchings to critical points of the Dirichlet energy. Such points are called harmonic maps. As there is no explicit expression for harmonic maps in general, we use a gradient descent ow with boundary condition to reach them, that we call harmonic ow. We present an application to color transfer, however many others applications can be envisaged using this general framework., This work was supported by European Research Council, Starting Grant ref. 306337. The second author acknowledges partial support by Spanish grants AACC, ref. TIN2011-15954-E, and Plan Nacional, ref. TIN2012-38112.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

A variational framework for single image dehazing

  • Galdran, Adrian
  • Vazquez-Corral, Javier
  • Pardo, David
  • Bertalmío, Marcelo
Comunicació presentada a: European Conference on Computer Vision Workshops (ECCV 2014), celebrada del 6 al 7 de setembre de 2014 a Zurich, Suïssa., Images captured under adverse weather conditions, such as haze or fog, typically exhibit low contrast and faded colors, which may severely limit the visibility within the scene. Unveiling the image struc- ture under the haze layer and recovering vivid colors out of a single image remains a challenging task, since the degradation is depth-dependent and conventional methods are unable to handle this problem. We propose to extend a well-known perception-inspired variational frame- work [1] for the task of single image dehazing. The main modification consists on the replacement of the value used by this framework for the grey-world hypothesis by an estimation of the mean of the clean image. This allows us to devise a variational method that requires no estimate of the depth structure of the scene, performing a spatially-variant contrast enhancement that effectively removes haze from far away regions. Experimental results show that our method competes well with other state- of-the-art methods in typical benchmark images, while outperforming current image dehazing methods in more challenging scenarios., JVC and MB were supported by European Research Council, Starting Grant ref. 306337, and by Spanish grants ref. TIN2011-15954-E and ref. TIN2012-38112.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

A nonlocal variational formulation for the improvement of tone mapped images

  • Cyriac, Praveen
  • Batard, Thomas
  • Bertalmío, Marcelo
Due to technical limitations, common display devices can only reproduce images having a low range of intensity values (dynamic range). As a consequence, the dynamic range of images encoding real world scenes, which is large, has to be compressed in order for them to be reproduced on a common display, and this technique is called tone mapping. Because there is no ground truth to compare with, evaluation of a tone mapped image has to be done by comparing with the original high dynamic range image. As standard metrics based on pixel-wise comparisons are not suitable for comparing images of different dynamic range, non local perceptual based metrics are commonly used. We propose a general method for optimizing tone mapped images with respect to a given non local metric. In particular, if the metric is perceptual, i.e. it involves perceptual concepts, we provide an adequate minimization strategy. Experiments on a particular perceptual metric tested with different tone mapped images provided by several tone mapping operators validate our approach., This work was supported by European Research Council, Starting Grant ref. 306337, and by Spanish grants ref. TIN2011-15954-E and ref. TIN2012-38112.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Color matching for stereoscopic cinema

  • Bertalmío, Marcelo
  • Levine, Stacey
In a stereo camera set-up for 3D cinema, much care is taken to ensure/nthat the cameras are both the same model and use identical/nparameter values. But an imperfect adjustment, the use of beam/nsplitters, as well as unavoidable differences in the characteristics/nof the cameras and lens systems, often cause visible differences in/ncolor among the two views. Many of these differences appear to/nbe local and therefore cannot be fully removed by common color/nmatching approaches, which are typically global methods. We propose/na simple yet effective method for local color matching, that/noperates in three steps. First, one view is chosen as the target and/nmorphed so that it becomes locally registered with the source view,/nthe one whose colors will be modified. Next, color matching is performed/non the source view by aligning each local histogram with/nthe corresponding local histogram in the warped target view. Finally,/nPoisson editing [9] is applied on the source regions which/nhave no correspondence in the target. For several professional, high/nquality examples of 3D sequences, we show that our algorithm outperforms/nfour different conventional color matching approaches., We would like to thank Pierre Jasmin of RE:Vision Effects Inc./nfor his unwavering support and his help running tests, and Clark/nDunbar of Mammoth HD Inc. for supplying us with professional/n3D footage. M. Bertalmío acknowledges support by European Research/nCouncil, Starting Grant ref. 306337, and Spanish grants AACC, ref. TIN2011-15954-E, and Plan Nacional, ref. TIN2012-/n38112. S. Levine is funded in part by NSF-DMS #0915219.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Denoising an image by denoising its components in a moving frame

  • Ghimpeteanu, Gabriela
  • Batard, Thomas
  • Bertalmío, Marcelo
  • Levine, Stacey
Comunicació presentada a: the 6th International Conference, (ICISP 2014), celebrada del 30. de juny al 2 de juliol de 2014 a Cherbourg, França., In this paper, we provide a new non-local method for image denoising. The key idea we develop is to denoise the components of the image in a well-chosen moving frame instead of the image itself.We prove the relevance of our approach by showing that the PSNR of a grayscale noisy image is lower than the PSNR of its components. Experiments show that applying the Non Local Means algorithm of Buades et al. on the components provides better results than applying it directly on the image., This work was supported by European Research Council, Starting Grant ref. 306337, and by Spanish grants AACC, ref. TIN2011-15954-E, and Plan Na- cional, ref. TIN2012-38112. S. Levine acknowledges partial support by NSF-DMS #0915219.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Variational approach for the fusion of exposure bracketed pairs

  • Bertalmío, Marcelo
  • Levine, Stacey
When taking pictures of a dark scene with artificial lighting, ambient light is not sufficient for most cameras to obtain both accurate color and detail information. The exposure bracketing feature usually available in many camera models enables the user to obtain a series of pictures taken in rapid succession with different exposure times; the implicit idea is that the user picks the best image from this set. But in many cases, none of these images is good enough; in general, good brightness and color information are retained from longer-exposure settings, whereas sharp details are obtained from shorter ones. In this paper, we propose a variational method for automatically combining an exposure-bracketed pair of images within a single picture that reflects the desired properties of each one. We introduce an energy functional consisting of two terms, one measuring the difference in edge information with the short-exposure image and the other measuring the local color difference with a warped version of the long-exposure image. This method is able to handle camera and subject motion as well as noise, and the results compare favorably with the state of the art., The first author acknowledges partial support by AACC project, reference TIN2011-15954-E, and by the ERC Starting Grant “Image Processing for Enhanced Cinematography.” The second author is funded in part by NSF-DMS #0915219.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Color stabilization along time and across shots of the same scene, for one or several cameras of unknown specifications

  • Vazquez-Corral, Javier
  • Bertalmío, Marcelo
We propose a method for color stabilization of shots of the same scene, taken under the same illumination, where one image is chosen as reference and one or several other images are modified so that their colors match those of the reference. We make use of two crucial but often overlooked observations: first, that the core of the color correction chain in a digital camera is simply a multiplication by a 3 × 3 matrix; second, that to color-match a source image to a reference image we do not need to compute their two color correction matrices, it is enough to compute the operation that transforms one matrix into the other. This operation is a 3 × 3 matrix as well, which we call H. Once we have H, we just multiply by it each pixel value of the source and obtain an image which matches in color the reference. To compute H we only require a set of pixel correspondences, we do not need any information about the cameras used, neither models nor specifications or parameter values. We propose an implementation of our framework which is very simple and fast, and show how it can be successfully employed in a number of situations, comparing favorably with the state of the art. There is a wide range of applications of our technique, both for amateur and professional photography and video: color matching for multicamera TV broadcasts, color matching for 3D cinema, color stabilization for amateur video, etc., This work was supported in part by the European Research Council under Grant 306337 and in part by the Spanish Research under Grant TIN2011-15954-E and Grant TIN2012-38112.