Optimizing photo composition

Aus de_evolutionary_art_org
Wechseln zu: Navigation, Suche

Liu, L., Chen, R., Wolf, L., Cohen-Or, D.: Optimizing photo composition. Comput. Graph. Forum 29(2), 469–478 (2010) DOI:





Aesthetic images evoke an emotional response that transcends mere visual appreciation. In this work we develop a novel computational means for evaluating the composition aesthetics of a given image based on measuring several well-grounded composition guidelines. A compound operator of crop-and-retarget is employed to change the relative position of salient regions in the image and thus to modify the composition aesthetics of the image. We propose an optimization method for automatically producing a maximally-aesthetic version of the input image. We validate the performance of the method and show its effectiveness in a variety of experiments.

Extended Abstract


Used References

AVIDAN , S., AND S HAMIR , A. 2007. Seam carving for content- aware image resizing. ACM Transactions on Graphics 26, 3.

BARNES , C., S HECHTMAN , E., F INKELSTEIN , A., AND G OLD - MAN , D. B. 2009. Patchmatch: A randomized correspondence algorithm for structural image editing. ACM Transactions on Graphics 28, 3.

B YERS , Z., D IXON , M., S MART, W. D., AND G RIMM , C. 2004. Say cheese! experiences with a robot photographer. AI Magazine 25, 3, 37–46.

C HO , T. S., B UTMAN , M., AVIDAN , S., AND F REEMAN , W. T. 2008. The patch transform and its applications to image editing. In Proceedings of CVPR.

C OHEN -O R , D., S ORKINE , O., G AL , R., L EYVAND , T., AND X U , Y.-Q. 2006. Color harmonization. ACM Transactions on Graphics 25, 3, 624–630.

F ELZENSZWALB , P. F., AND H UTTENLOCHER , D. P. 2004. Effi- cient graph-based image segmentation. International Journal of Computer Vision 59, 2, 167–181.

G AL , R., S ORKINE , O., AND C OHEN -O R , D. 2006. Feature- aware texturing. In Eurographics Symp. on Rendering, 297–303.

G OOCH , B., R EINHARD , E., M OULDING , C., AND S HIRLEY, P. 2001. Artistic composition for image creation. In Proc. of the 12th Eurographics workshop on Rendering Technique, 83–88.

G RILL , T., AND S CANLON , M. 1990. Photographic Composition. Watson-Guptill.

I TTI , L., KOCH , C., AND N IEBUR , E. 1998. A model of saliency- based visual attention for rapid scene analysis. IEEE Trans. on Pattern Analysis and Machine Intelligence 20, 1254–1259.

K ENNEDY, J., AND E BERHART, R. 1995. Particle swarm opti- mization. In Proc. IEEE Conf. on Neural Networks, 1942–1948.

KOWALSKI , M. A., H UGHES , J. F., RUBIN , C. B., AND O HYA , J. 2001. User-guided composition effects for art-based rendering. In Proc. of the Symposium on Interactive 3D graphics, 99–102.

K RAGES , B. 2005. Photography: The Art of Composition. All- worth Press.

L EYVAND , T., C OHEN -O R , D., D ROR , G., AND L ISCHINSKI , D. 2008. Data-driven enhancement of facial attractiveness. ACM Trans. Graph. 27, 3.

L I , S., Z HU , L., Z HANG , Z., B LAKE , A., Z HANG , H., AND S HUM , H. 2002. Statistical learning of multi-view face detec- tion. In 7th European Conference on Computer Vision, 67–81.

L OK , S., F EINER , S., AND N GAI , G. 2004. Evaluation of visual balance for automated layout. Intelligent User Interfaces, 101–8.

M ARTIN , D., F OWLKES , C., TAL , D., AND M ALIK , J. 2001. A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecologi- cal statistics. In International Conference on Computer Vision, vol. 2, 416–423.

M ARTINEZ , B., AND B LOCK , J. 1998. Visual Forces, an Intro- duction to Design. Prentice-Hall, New York.

N ISHIYAMA , M., O KABE , T., S ATO , Y., AND S ATO , I. 2009. Sensation-based photo cropping. In Proc. ACM International Conference on Multimedia.

P ETERS , G. 2007. Aesthetic primitives of images for visualization. In 11th Int. Conf on Information Visualization, 316–325.

R IVOTTI , V., P ROENAA , J., J. J ORGE , J., AND S OUSA , M. 2007. Composition principles for quality depiction and aesthetics. In The International Symposium on Computational Aesthetics in Graphics, Visualization, and Imaging, 37–44.

RUBINSTEIN , M., S HAMIR , A., AND AVIDAN , S. 2008. Im- proved seam carving for video retargeting. ACM Transactions on Graphics 27, 3.

RUBINSTEIN , M., S HAMIR , A., AND AVIDAN , S. 2009. Multi- operator media retargeting. ACM Transactions on Graphics 28, 3.

S ANTELLA , A., AGRAWALA , M., D E C ARLO , D., S ALESIN , D. H., AND C OHEN , M. F. 2006. Gaze-based interaction for semi-automatic photo cropping. In ACM Human Factors in Computing Systems (CHI), 771–780.

S ETLUR , V., TAKAGI , S., R ASKAR , R., G LEICHER , M., AND G OOCH , B. 2005. Automatic image retargeting. In Proc. of Mobile and Ubiquitous Multimedia (MUM), 59–68.

S HAMIR , A., AND S ORKINE , O. 2009. Visual media retargeting. In SIGGRAPH Asia Course 2009.

S IMAKOV, D., C ASPI , Y., S HECHTMAN , E., AND I RANI , M. 2008. Summarizing visual data using bidirectional similarity. In Proceedings of CVPR.

S UH , B., L ING , H., B EDERSON , B., AND JAOBS , D. 2003. Au- tomatic thumbnail cropping and it’s effectivness. In ACM Con- ference on User Interface and Software Technolgy, 95–104.

WANG , J., AND C OHEN , M., 2006. Simultaneous matting and compositing. ACM SIGGRAPH Technical Sketch, July.

WANG , Y.-S., TAI , C.-L., S ORKINE , O., AND L EE , T.-Y. 2008. Optimized scale-and-stretch for image resizing. ACM Transac- tions on Graphics 27, 5.

W OLF, L., G UTTMANN , M., AND C OHEN -O R , D. 2007. Non- homogeneous content-driven video-retargeting. In Proceedings of the 11th IEEE International Conference on Computer Vision.

Z HANG , M., Z HANG , L., S UN , Y., F ENG , L., AND M A , W.-Y. 2005. Auto cropping for digital photographs. In Proc. of IEEE International Conference on Multimedia and Expo.


Full Text

http://www.math.zju.edu.cn/ligangliu/CAGD/Projects/Composition/paper/Composition-TR.pdf (32 MB)

intern file

Sonstige Links