A framework for photo-quality assessment and enhancement based on visual aesthetics
Inhaltsverzeichnis
Referenz
Bhattacharya, S., Sukthankar, R., Shah, M.: A framework for photo-quality assessment and enhancement based on visual aesthetics. In: Proceedings of the international conference on Multimedia, ACM (2010) 271-280
DOI
http://dx.doi.org/10.1145/1873951.1873990
Abstract
We present an interactive application that enables users to improve the visual aesthetics of their digital photographs using spatial recomposition. Unlike earlier work that focuses either on photo quality assessment or interactive tools for photo editing, we enable the user to make informed decisions about improving the composition of a photograph and to implement them in a single framework. Specifically, the user interactively selects a foreground object and the system presents recommendations for where it can be moved in a manner that optimizes a learned aesthetic metric while obeying semantic constraints. For photographic compositions that lack a distinct foreground object, our tool provides the user with cropping or expanding recommendations that improve its aesthetic quality. We learn a support vector regression model for capturing image aesthetics from user data and seek to optimize this metric during recomposition. Rather than prescribing a fully-automated solution, we allow user-guided object segmentation and inpainting to ensure that the final photograph matches the user's criteria. Our approach achieves 86% accuracy in predicting the attractiveness of unrated images, when compared to their respective human rankings. Additionally, 73% of the images recomposited using our tool are ranked more attractive than their original counterparts by human raters.
Extended Abstract
Bibtex
@inproceedings{Bhattacharya:2010:FPA:1873951.1873990,
author = {Bhattacharya, Subhabrata and Sukthankar, Rahul and Shah, Mubarak},
title = {A Framework for Photo-quality Assessment and Enhancement Based on Visual Aesthetics},
booktitle = {Proceedings of the 18th ACM International Conference on Multimedia},
series = {MM '10},
year = {2010},
isbn = {978-1-60558-933-6},
location = {Firenze, Italy},
pages = {271--280},
numpages = {10},
url = {http://doi.acm.org/10.1145/1873951.1873990 http://de.evo-art.org/index.php?title=A_framework_for_photo-quality_assessment_and_enhancement_based_on_visual_aesthetics},
doi = {10.1145/1873951.1873990},
acmid = {1873990},
publisher = {ACM},
address = {New York, NY, USA},
keywords = {interactive photo tools, quality enhancement, spatial recomposition},
}
Used References
1 Shai Avidan , Ariel Shamir, Seam carving for content-aware image resizing, ACM SIGGRAPH 2007 papers, August 05-09, 2007, San Diego, California http://doi.acm.org/10.1145/1275808.1276390
2 S. Banerjee and B. Evans. Unsupervised automation of photographic composition rules. In SPIE Sensors, Color, Cameras, and Systems for Digital Photography, 2004.
3 Matthew Boutell , Jiebo Luo, Bayesian fusion of camera metadata cues in semantic scene classification, Proceedings of the 2004 IEEE computer society conference on Computer vision and pattern recognition, June 27-July 02, 2004, Washington, D.C., USA http://dl.acm.org/citation.cfm?id=1896390&CFID=558819604&CFTOKEN=68186175
4 T. S. Cho, M. Butman, S. Avidan, and W. T. Freeman. The patch transform and its applications to image editing. In CVPR, 2008.
5 N. Damera-Venkata , T. D. Kite , W. S. Geisler , B. L. Evans , A. C. Bovik, Image quality assessment based on a degradation model, IEEE Transactions on Image Processing, v.9 n.4, p.636-650, April 2000 http://dx.doi.org/10.1109/83.841940
6 Ritendra Datta , Dhiraj Joshi , Jia Li , James Z. Wang, Studying aesthetics in photographic images using a computational approach, Proceedings of the 9th European conference on Computer Vision, May 07-13, 2006, Graz, Austria http://dx.doi.org/10.1007/11744078_23
7 Ritendra Datta , Jia Li , James Z. Wang, Learning the consensus on visual quality for next-generation image management, Proceedings of the 15th international conference on Multimedia, September 25-29, 2007, Augsburg, Germany http://doi.acm.org/10.1145/1291233.1291364
8 Richard Hartley , Andrew Zisserman, Multiple View Geometry in Computer Vision, Cambridge University Press, New York, NY, 2003 http://dl.acm.org/citation.cfm?id=861369&CFID=558819604&CFTOKEN=68186175
9 Derek Hoiem , Alexei A. Efros , Martial Hebert, Recovering Surface Layout from an Image, International Journal of Computer Vision, v.75 n.1, p.151-172, October 2007 http://dx.doi.org/10.1007/s11263-006-0031-y
10 Thorsten Joachims, Making large-scale support vector machine learning practical, Advances in kernel methods: support vector learning, MIT Press, Cambridge, MA, 1999 http://dl.acm.org/citation.cfm?id=299104&CFID=558819604&CFTOKEN=68186175
11 P. Jonas. Photographic composition simplified. Amphoto Publishers, 1976.
12 Yan Ke , Xiaoou Tang , Feng Jing, The Design of High-Level Features for Photo Quality Assessment, Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, p.419-426, June 17-22, 2006 http://dx.doi.org/10.1109/CVPR.2006.303
13 Tommer Leyvand , Daniel Cohen-Or , Gideon Dror , Dani Lischinski, Data-driven enhancement of facial attractiveness, ACM SIGGRAPH 2008 papers, August 11-15, 2008, Los Angeles, California http://doi.acm.org/10.1145/1399504.1360637
14 Ce Liu , Richard Szeliski , Sing Bing Kang , C. Lawrence Zitnick , William T. Freeman, Automatic Estimation and Removal of Noise from a Single Image, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.30 n.2, p.299-314, February 2008 http://dx.doi.org/10.1109/TPAMI.2007.1176
15 M. Livio. The golden ratio and aesthetics. Plus Magazine -- Living Mathematics, 22, Nov. 2002.
16 Yiwen Luo , Xiaoou Tang, Photo and Video Quality Evaluation: Focusing on the Subject, Proceedings of the 10th European Conference on Computer Vision: Part III, October 12-18, 2008, Marseille, France http://dx.doi.org/10.1007/978-3-540-88690-7_29
17 Atif Bin Mansoor , Maaz Haider , Ajmal S. Mian , Shoab A. Khan, A Hybrid Image Quality Measure for Automatic Image Quality Assessment, Proceedings of the 16th Scandinavian Conference on Image Analysis, June 15-July 18, 2009, Oslo, Norway http://dx.doi.org/10.1007/978-3-642-02230-2_10
18 Masashi Nishiyama , Takahiro Okabe , Yoichi Sato , Imari Sato, Sensation-based photo cropping, Proceedings of the 17th ACM international conference on Multimedia, October 19-24, 2009, Beijing, China http://doi.acm.org/10.1145/1631272.1631351
19 Xiaoshuai Sun , Hongxun Yao , Rongrong Ji , Shaohui Liu, Photo assessment based on computational visual attention model, Proceedings of the 17th ACM international conference on Multimedia, October 19-24, 2009, Beijing, China http://doi.acm.org/10.1145/1631272.1631351
20 Dirk Walther , Christof Koch, 2006 Special Issue: Modeling attention to salient proto-objects, Neural Networks, v.19 n.9, p.1395-1407, November, 2006 http://dx.doi.org/10.1016/j.neunet.2006.10.001
21 Junyong You , Andrew Perkis , Miska M. Hannuksela , Moncef Gabbouj, Perceptual quality assessment based on visual attention analysis, Proceedings of the 17th ACM international conference on Multimedia, October 19-24, 2009, Beijing, China http://doi.acm.org/10.1145/1631272.1631356
22 Y. Zhang, J. Xiao, and M. Shah. Region completion in single image. In Proc. EUROGRAPHICS, 2004.
Links
Full Text
http://www.cs.cmu.edu/~rahuls/pub/mm2010-rahuls.pdf
