Realtime Aesthetic Image Retargeting

Aus de_evolutionary_art_org
Wechseln zu: Navigation, Suche


Ligang Liu, Yong Jin, Qingbiao Wu: Realtime Aesthetic Image Retargeting. In: Pauline Jepp, Oliver Deussen (Eds.): Eurographics Workshop on Computational Aesthetics, 2010. 1-8



Humans have always sought to achieve aesthetics in art. In this paper, we present a novel approach for retargeting images to different aspect ratios while improving the composition aesthetics of the results. A simpler computational aesthetic energy is proposed and used to drive the salient objects and prominent lines to move towards their corresponding optimal positions. A mesh-based warping scheme is presented to transform the images while protecting the visual appearance of salient objects. The objective function is quadratic and thus it can be quickly minimized by solving a sparse linear system. The retargeting results are generated in realtime while the user changes the aspect ratios of the target images. A variety of experiments have shown the applicability and effectiveness of our algorithm.

Extended Abstract


author = {Liu, Ligang and Jin, Yong and Wu, Qingbiao},
title = {Realtime Aesthetic Image Retargeting},
booktitle = {Proceedings of the Sixth International Conference on Computational Aesthetics in Graphics, Visualization and Imaging},
series = {Computational Aesthetics'10},
year = {2010},
isbn = {978-3-905674-24-8},
location = {London, United Kingdom},
pages = {1--8},
numpages = {8},
url = {, },
doi = {10.2312/COMPAESTH/COMPAESTH10/001-008},
acmid = {2381314},
publisher = {Eurographics Association},
address = {Aire-la-Ville, Switzerland, Switzerland},

Used References

Shai Avidan , Ariel Shamir, Seam carving for content-aware image resizing, ACM Transactions on Graphics (TOG), v.26 n.3, July 2007

Zachary Byers , Michael Dixion , William D. Smart , Cindy M. Grimm, Say cheese! Experiences with a robot photographer, AI Magazine, v.25 n.3, p.37-46, Fall 2004

Connelly Barnes , Eli Shechtman , Adam Finkelstein , Dan B Goldman, PatchMatch: a randomized correspondence algorithm for structural image editing, ACM Transactions on Graphics (TOG), v.28 n.3, August 2009

Ritendra Datta , James Z. Wang, ACQUINE: aesthetic quality inference engine - real-time automatic rating of photo aesthetics, Proceedings of the international conference on Multimedia information retrieval, March 29-31, 2010, Philadelphia, Pennsylvania, USA

Leandro A. F. Fernandes , Manuel M. Oliveira, Real-time line detection through an improved Hough transform voting scheme, Pattern Recognition, v.41 n.1, p.299-314, January, 2008

Yanwen Guo , Feng Liu , Jian Shi , Zhi-Hua Zhou , Michael Gleicher, Image retargeting using mesh parametrization, IEEE Transactions on Multimedia, v.11 n.5, p.856-867, August 2009

Bruce Gooch , Erik Reinhard , Chris Moulding , Peter Shirley, Artistic Composition for Image Creation, Proceedings of the 12th Eurographics Workshop on Rendering Techniques, p.83-88, June 25-27, 2001

GRILL T., SCANLON M.: Photographic Composition. Watson-Guptill, 1990.

Ran Gal , Olga Sorkine , Daniel Cohen-Or, Feature-aware texturing, Proceedings of the 17th Eurographics conference on Rendering Techniques, June 26-28, 2006, Nicosia, Cyprus

HAREL J., KOCH C., PERONA P.: Graph-based visual saliency. In Proc. Neural Information Processing Systems (NIPS) (2006), pp. 545-552.

Florian Hoenig, Defining computational aesthetics, Proceedings of the First Eurographics conference on Computational Aesthetics in Graphics, Visualization and Imaging, May 18-20, 2005, Girona, Spain

Intel math kernel libarary.

Yong Jin , Ligang Liu , Qingbiao Wu, Nonhomogeneous scaling optimization for realtime image resizing, The Visual Computer: International Journal of Computer Graphics, v.26 n.6-8, p.769-778, June 2010

Z. Karni , D. Freedman , C. Gotsman, Energy-based image deformation, Proceedings of the Symposium on Geometry Processing, July 15-17, 2009, Berlin, Germany

Philipp Krähenbühl , Manuel Lang , Alexander Hornung , Markus Gross, A system for retargeting of streaming video, ACM Transactions on Graphics (TOG), v.28 n.5, December 2009

KRAGES B.: Photography: The Art of Composition. Allworth Press, 2005.

LIU L., CHEN R., WOLF L., COHEN-OR D.: Optimizing photo composition. Computer Graphics Forum (Proc. of Eurographics) 29, 2 (2010).

Simon Lok , Steven Feiner , Gary Ngai, Evaluation of visual balance for automated layout, Proceedings of the 9th international conference on Intelligent user interfaces, January 13-16, 2004, Funchal, Madeira, Portugal

Feng Liu , Michael Gleicher, Automatic image retargeting with fisheye-view warping, Proceedings of the 18th annual ACM symposium on User interface software and technology, October 23-26, 2005, Seattle, WA, USA

PRITCH Y., KAV-VENAKI E., PELEG S.: Shift-map image editing. In Proc. of ICCV (2009).

Michael Rubinstein , Ariel Shamir , Shai Avidan, Improved seam carving for video retargeting, ACM Transactions on Graphics (TOG), v.27 n.3, August 2008

Michael Rubinstein , Ariel Shamir , Shai Avidan, Multi-operator media retargeting, ACM Transactions on Graphics (TOG), v.28 n.3, August 2009

Anthony Santella , Maneesh Agrawala , Doug DeCarlo , David Salesin , Michael Cohen, Gaze-based interaction for semi-automatic photo cropping, Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, April 22-27, 2006, Montréal, Québec, Canada

Bongwon Suh , Haibin Ling , Benjamin B. Bederson , David W. Jacobs, Automatic thumbnail cropping and its effectiveness, Proceedings of the 16th annual ACM symposium on User interface software and technology, p.95-104, November 02-05, 2003, Vancouver, Canada

Ariel Shamir , Olga Sorkine, Visual media retargeting, ACM SIGGRAPH ASIA 2009 Courses, p.1-13, December 16-19, 2009, Yokohama, Japan

Vidya Setlur , Saeko Takagi , Ramesh Raskar , Michael Gleicher , Bruce Gooch, Automatic image retargeting, Proceedings of the 4th international conference on Mobile and ubiquitous multimedia, December 08-10, 2005, Christchurch, New Zealand

WOLF L., GUTTMANN M., COHEN-OR D.: Nonhomogeneous content-driven video-retargeting. In Proceedings of the 11th IEEE International Conference on Computer Vision (2007).

Yu-Shuen Wang , Chiew-Lan Tai , Olga Sorkine , Tong-Yee Lee, Optimized scale-and-stretch for image resizing, ACM Transactions on Graphics (TOG), v.27 n.5, December 2008

Shizhe Zhou , Hongbo Fu , Ligang Liu , Daniel Cohen-Or , Xiaoguang Han, Parametric reshaping of human bodies in images, ACM Transactions on Graphics (TOG), v.29 n.4, July 2010

ZHANG M., ZHANG L., SUN Y., FENG L., MA W.-Y.: Auto cropping for digital photographs. In Proc. of IEEE International Conference on Multimedia and Expo (2005).


Full Text

intern file

Sonstige Links