Extracting the Essence from Sets of Images

Aus de_evolutionary_art_org
Wechseln zu: Navigation, Suche


Marc Alexa: Extracting the Essence from Sets of Images. In: Douglas W. Cunningham, Gary W. Meyer, László Neumann, Alan Dunning, Raquel Paricio (Eds.):Eurographics Workshop on Computational Aesthetics, 2007. 113-120




We use a set of photographs showing similar scenes as a model for a single photograph this scene. A distance measure for this model is defined by correlating the neigborhoods of pixels in similar positions. A cross analysis of the source images yields confidence values for their pixels. The confidence values together with the distances in pixels are used to steer a variable bandwidth mean shift algorithm that moves an arbitrary image towards one conforming with the model. Furthermore, distances are also used for a non-local means reconstruction of image areas that have no consistent explanation in the source images. This allows reconstructing images of scenes that are inconsistently documented in the source images, e.g. are occluded in the majority of images.

Extended Abstract


author = {Alexa, Marc},
title = {Extracting the Essence from Sets of Images},
booktitle = {Proceedings of the Third Eurographics Conference on Computational Aesthetics in Graphics, Visualization and Imaging},
series = {Computational Aesthetics'07},
year = {2007},
isbn = {978-3-905673-43-2},
location = {Alberta, Canada},
pages = {113--120},
numpages = {8},
url = {http://dx.doi.org/10.2312/COMPAESTH/COMPAESTH07/113-120, http://de.evo-art.org/index.php?title=Extracting_the_Essence_from_Sets_of_Images },
doi = {10.2312/COMPAESTH/COMPAESTH07/113-120},
acmid = {2381274},
publisher = {Eurographics Association},
address = {Aire-la-Ville, Switzerland, Switzerland},

Used References

Aseem Agarwala , Mira Dontcheva , Maneesh Agrawala , Steven Drucker , Alex Colburn , Brian Curless , David Salesin , Michael Cohen, Interactive digital photomontage, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004 http://doi.acm.org/10.1145/1015706.1015718

Amit Agrawal , Ramesh Raskar , Shree K. Nayar , Yuanzhen Li, Removing photography artifacts using gradient projection and flash-exposure sampling, ACM Transactions on Graphics (TOG), v.24 n.3, July 2005 http://doi.acm.org/10.1145/1073204.1073269

Michael Ashikhmin, A tone mapping algorithm for high contrast images, Proceedings of the 13th Eurographics workshop on Rendering, June 26-28, 2002, Pisa, Italy http://dl.acm.org/citation.cfm?id=581916&CFID=588525319&CFTOKEN=29804931

Suyash P. Awate , Tolga Tasdizen , Ross T. Whitaker, Unsupervised texture segmentation with nonparametric neighborhood statistics, Proceedings of the 9th European conference on Computer Vision, May 07-13, 2006, Graz, Austria http://dx.doi.org/10.1007/11744047_38

Suyash P. Awate , Ross T. Whitaker, Unsupervised, Information-Theoretic, Adaptive Image Filtering for Image Restoration, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.28 n.3, p.364-376, March 2006 http://dx.doi.org/10.1109/TPAMI.2006.64

Antoni Buades , Bartomeu Coll , Jean-Michel Morel, A Non-Local Algorithm for Image Denoising, Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 2, p.60-65, June 20-26, 2005 http://dx.doi.org/10.1109/CVPR.2005.38

BUADES A., COLL B., MOREL J.-M.: A review of image denoising algorithms, with a new one. Multiscale Modeling & Simulation 4, 2 (2005), 490-530.

Shenchang Eric Chen, QuickTime VR: an image-based approach to virtual environment navigation, Proceedings of the 22nd annual conference on Computer graphics and interactive techniques, p.29-38, September 1995 http://doi.acm.org/10.1145/218380.218395

Dorin Comaniciu , Peter Meer, Mean Shift: A Robust Approach Toward Feature Space Analysis, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.24 n.5, p.603-619, May 2002 http://dx.doi.org/10.1109/34.1000236

Dorin Comaniciu, An Algorithm for Data-Driven Bandwidth Selection, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.25 n.2, p.281-288, February 2003 http://dx.doi.org/10.1109/TPAMI.2003.1177159

COMANICIU D., RAMESH V., MEER P.: The variable bandwidth mean shift and data-driven scale selection. In ICCV (2001), pp. 438-445.

Iddo Drori , Daniel Cohen-Or , Hezy Yeshurun, Fragment-based image completion, ACM Transactions on Graphics (TOG), v.22 n.3, July 2003 http://doi.acm.org/10.1145/882262.882267

Frédo Durand , Julie Dorsey, Fast bilateral filtering for the display of high-dynamic-range images, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002 http://doi.acm.org/10.1145/566654.566574

Richard O. Duda , Peter E. Hart , David G. Stork, Pattern Classification (2nd Edition), Wiley-Interscience, 2000

Paul E. Debevec , Jitendra Malik, Recovering high dynamic range radiance maps from photographs, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.369-378, August 1997 [doi>10.1145/258734.258884]

Elmar Eisemann , Frédo Durand, Flash photography enhancement via intrinsic relighting, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004 [doi>10.1145/1015706.1015778]

Alexei A. Efros , William T. Freeman, Image quilting for texture synthesis and transfer, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.341-346, August 2001 [doi>10.1145/383259.383296]

Alexei A. Efros , Thomas K. Leung, Texture Synthesis by Non-Parametric Sampling, Proceedings of the International Conference on Computer Vision-Volume 2, p.1033, September 20-25, 1999

Raanan Fattal , Dani Lischinski , Michael Werman, Gradient domain high dynamic range compression, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002 http://doi.acm.org/10.1145/566654.566573

FREEMAN W. T., ZHANG H.: Shape-time photography. In 2003 Conference on Computer Vision and Pattern Recognition (CVPR 2003) (June 2003), pp. 151- 157.

HAEBERLI P.: Grafica obscura, 1984. web site http://www.sgi.com/grafica/.

KHAN E. A., AKYUZ A. O., REINHARD E.: Ghost removal in high dynamic range images. In IEEE International Conference on Image Processing (2006), pp. 2005-2008.

Rafal Mantiuk , Karol Myszkowski , Hans-Peter Seidel, A perceptual framework for contrast processing of high dynamic range images, Proceedings of the 2nd symposium on Applied perception in graphics and visualization, August 26-28, 2005, A Coroña, Spain http://doi.acm.org/10.1145/1080402.1080418

Georg Petschnigg , Richard Szeliski , Maneesh Agrawala , Michael Cohen , Hugues Hoppe , Kentaro Toyama, Digital photography with flash and no-flash image pairs, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004 http://doi.acm.org/10.1145/1015706.1015777

Erik Reinhard , Michael Stark , Peter Shirley , James Ferwerda, Photographic tone reproduction for digital images, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002 http://doi.acm.org/10.1145/566654.566575

Ramesh Raskar , Jack Tumblin, Computational photography, ACM SIGGRAPH 2005 Courses, July 31-August 04, 2005, Los Angeles, California http://doi.acm.org/10.1145/1198555.1198561

Erik Reinhard , Greg Ward , Sumanta Pattanaik , Paul Debevec, High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting (The Morgan Kaufmann Series in Computer Graphics), Morgan Kaufmann Publishers Inc., San Francisco, CA, 2005 http://dl.acm.org/citation.cfm?id=1208706&CFID=588525319&CFTOKEN=29804931

Richard Szeliski , Heung-Yeung Shum, Creating full view panoramic image mosaics and environment maps, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.251-258, August 1997 http://doi.acm.org/10.1145/258734.258861

WARD G.: Fast, robust image registration for compositing high dynamic range photographcs from hand-held exposures. Journal of Graphics Tools 8, 2 (2003), 17-30.

Li-Yi Wei , Marc Levoy, Fast texture synthesis using tree-structured vector quantization, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.479-488, July 2000 http://doi.acm.org/10.1145/344779.345009


Full Text


intern file

Sonstige Links