Realtime Aesthetic Image Retargeting

Aus de_evolutionary_art_org
Wechseln zu: Navigation, Suche


Reference

Ligang Liu, Yong Jin, Qingbiao Wu: Realtime Aesthetic Image Retargeting. In: Pauline Jepp, Oliver Deussen (Eds.): Eurographics Workshop on Computational Aesthetics, 2010. 1-8

DOI

http://dx.doi.org/10.2312/COMPAESTH/COMPAESTH10/001-008

Abstract

Humans have always sought to achieve aesthetics in art. In this paper, we present a novel approach for retargeting images to different aspect ratios while improving the composition aesthetics of the results. A simpler computational aesthetic energy is proposed and used to drive the salient objects and prominent lines to move towards their corresponding optimal positions. A mesh-based warping scheme is presented to transform the images while protecting the visual appearance of salient objects. The objective function is quadratic and thus it can be quickly minimized by solving a sparse linear system. The retargeting results are generated in realtime while the user changes the aspect ratios of the target images. A variety of experiments have shown the applicability and effectiveness of our algorithm.

Extended Abstract

Bibtex

@inproceedings{Liu:2010:RAI:2381312.2381314,
author = {Liu, Ligang and Jin, Yong and Wu, Qingbiao},
title = {Realtime Aesthetic Image Retargeting},
booktitle = {Proceedings of the Sixth International Conference on Computational Aesthetics in Graphics, Visualization and Imaging},
series = {Computational Aesthetics'10},
year = {2010},
isbn = {978-3-905674-24-8},
location = {London, United Kingdom},
pages = {1--8},
numpages = {8},
url = {http://dx.doi.org/10.2312/COMPAESTH/COMPAESTH10/001-008, http://de.evo-art.org/index.php?title=Realtime_Aesthetic_Image_Retargeting },
doi = {10.2312/COMPAESTH/COMPAESTH10/001-008},
acmid = {2381314},
publisher = {Eurographics Association},
address = {Aire-la-Ville, Switzerland, Switzerland},
}

Used References

Shai Avidan , Ariel Shamir, Seam carving for content-aware image resizing, ACM Transactions on Graphics (TOG), v.26 n.3, July 2007 http://doi.acm.org/10.1145/1276377.1276390

Zachary Byers , Michael Dixion , William D. Smart , Cindy M. Grimm, Say cheese! Experiences with a robot photographer, AI Magazine, v.25 n.3, p.37-46, Fall 2004 http://dl.acm.org/citation.cfm?id=1045750&CFID=588525319&CFTOKEN=29804931

Connelly Barnes , Eli Shechtman , Adam Finkelstein , Dan B Goldman, PatchMatch: a randomized correspondence algorithm for structural image editing, ACM Transactions on Graphics (TOG), v.28 n.3, August 2009 http://doi.acm.org/10.1145/1531326.1531330

Ritendra Datta , James Z. Wang, ACQUINE: aesthetic quality inference engine - real-time automatic rating of photo aesthetics, Proceedings of the international conference on Multimedia information retrieval, March 29-31, 2010, Philadelphia, Pennsylvania, USA http://doi.acm.org/10.1145/1743384.1743457

Leandro A. F. Fernandes , Manuel M. Oliveira, Real-time line detection through an improved Hough transform voting scheme, Pattern Recognition, v.41 n.1, p.299-314, January, 2008 http://dx.doi.org/10.1016/j.patcog.2007.04.003

Yanwen Guo , Feng Liu , Jian Shi , Zhi-Hua Zhou , Michael Gleicher, Image retargeting using mesh parametrization, IEEE Transactions on Multimedia, v.11 n.5, p.856-867, August 2009 http://dx.doi.org/10.1109/TMM.2009.2021781

Bruce Gooch , Erik Reinhard , Chris Moulding , Peter Shirley, Artistic Composition for Image Creation, Proceedings of the 12th Eurographics Workshop on Rendering Techniques, p.83-88, June 25-27, 2001 http://dl.acm.org/citation.cfm?id=732295&CFID=588525319&CFTOKEN=29804931

GRILL T., SCANLON M.: Photographic Composition. Watson-Guptill, 1990.

Ran Gal , Olga Sorkine , Daniel Cohen-Or, Feature-aware texturing, Proceedings of the 17th Eurographics conference on Rendering Techniques, June 26-28, 2006, Nicosia, Cyprus http://dx.doi.org/10.2312/EGWR/EGSR06/297-303

HAREL J., KOCH C., PERONA P.: Graph-based visual saliency. In Proc. Neural Information Processing Systems (NIPS) (2006), pp. 545-552.

Florian Hoenig, Defining computational aesthetics, Proceedings of the First Eurographics conference on Computational Aesthetics in Graphics, Visualization and Imaging, May 18-20, 2005, Girona, Spain http://dx.doi.org/10.2312/COMPAESTH/COMPAESTH05/013-018

Intel math kernel libarary. http://developer.intel.com.

Yong Jin , Ligang Liu , Qingbiao Wu, Nonhomogeneous scaling optimization for realtime image resizing, The Visual Computer: International Journal of Computer Graphics, v.26 n.6-8, p.769-778, June 2010 http://dx.doi.org/10.1007/s00371-010-0472-8

Z. Karni , D. Freedman , C. Gotsman, Energy-based image deformation, Proceedings of the Symposium on Geometry Processing, July 15-17, 2009, Berlin, Germany http://dl.acm.org/citation.cfm?id=1735605&CFID=588525319&CFTOKEN=29804931

Philipp Krähenbühl , Manuel Lang , Alexander Hornung , Markus Gross, A system for retargeting of streaming video, ACM Transactions on Graphics (TOG), v.28 n.5, December 2009 http://doi.acm.org/10.1145/1618452.1618472

KRAGES B.: Photography: The Art of Composition. Allworth Press, 2005.

LIU L., CHEN R., WOLF L., COHEN-OR D.: Optimizing photo composition. Computer Graphics Forum (Proc. of Eurographics) 29, 2 (2010).

Simon Lok , Steven Feiner , Gary Ngai, Evaluation of visual balance for automated layout, Proceedings of the 9th international conference on Intelligent user interfaces, January 13-16, 2004, Funchal, Madeira, Portugal http://doi.acm.org/10.1145/964442.964462

Feng Liu , Michael Gleicher, Automatic image retargeting with fisheye-view warping, Proceedings of the 18th annual ACM symposium on User interface software and technology, October 23-26, 2005, Seattle, WA, USA http://doi.acm.org/10.1145/1095034.1095061

PRITCH Y., KAV-VENAKI E., PELEG S.: Shift-map image editing. In Proc. of ICCV (2009).

Michael Rubinstein , Ariel Shamir , Shai Avidan, Improved seam carving for video retargeting, ACM Transactions on Graphics (TOG), v.27 n.3, August 2008 http://doi.acm.org/10.1145/1360612.1360615

Michael Rubinstein , Ariel Shamir , Shai Avidan, Multi-operator media retargeting, ACM Transactions on Graphics (TOG), v.28 n.3, August 2009 http://doi.acm.org/10.1145/1531326.1531329

Anthony Santella , Maneesh Agrawala , Doug DeCarlo , David Salesin , Michael Cohen, Gaze-based interaction for semi-automatic photo cropping, Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, April 22-27, 2006, Montréal, Québec, Canada http://doi.acm.org/10.1145/1124772.1124886

Bongwon Suh , Haibin Ling , Benjamin B. Bederson , David W. Jacobs, Automatic thumbnail cropping and its effectiveness, Proceedings of the 16th annual ACM symposium on User interface software and technology, p.95-104, November 02-05, 2003, Vancouver, Canada http://doi.acm.org/10.1145/964696.964707

Ariel Shamir , Olga Sorkine, Visual media retargeting, ACM SIGGRAPH ASIA 2009 Courses, p.1-13, December 16-19, 2009, Yokohama, Japan http://doi.acm.org/10.1145/1665817.1665828

Vidya Setlur , Saeko Takagi , Ramesh Raskar , Michael Gleicher , Bruce Gooch, Automatic image retargeting, Proceedings of the 4th international conference on Mobile and ubiquitous multimedia, December 08-10, 2005, Christchurch, New Zealand http://doi.acm.org/10.1145/1149488.1149499

WOLF L., GUTTMANN M., COHEN-OR D.: Nonhomogeneous content-driven video-retargeting. In Proceedings of the 11th IEEE International Conference on Computer Vision (2007).

Yu-Shuen Wang , Chiew-Lan Tai , Olga Sorkine , Tong-Yee Lee, Optimized scale-and-stretch for image resizing, ACM Transactions on Graphics (TOG), v.27 n.5, December 2008 http://doi.acm.org/10.1145/1409060.1409071

Shizhe Zhou , Hongbo Fu , Ligang Liu , Daniel Cohen-Or , Xiaoguang Han, Parametric reshaping of human bodies in images, ACM Transactions on Graphics (TOG), v.29 n.4, July 2010 http://doi.acm.org/10.1145/1778765.1778863

ZHANG M., ZHANG L., SUN Y., FENG L., MA W.-Y.: Auto cropping for digital photographs. In Proc. of IEEE International Conference on Multimedia and Expo (2005).


Links

Full Text

http://www.math.zju.edu.cn/ligangliu/publications/papers/2010_cae_retargeting_paper.pdf

intern file

Sonstige Links

http://dl.acm.org/citation.cfm?id=2381312.2381314&coll=DL&dl=GUIDE&CFID=588525319&CFTOKEN=29804931

Abgerufen von „http://de.evo-art.org/index.php?title=Realtime_Aesthetic_Image_Retargeting&oldid=31924“