Patternista: Learning Element Style Compatibility and Spatial Composition for Ring-based Layout Decoration

Aus de_evolutionary_art_org
Wechseln zu: Navigation, Suche


Huy Quoc Phan, Jingwan Lu, Paul Asente, Antoni B. Chan, and Hongbo Fu: Patternista: Learning Element Style Compatibility and Spatial Composition for Ring-based Layout Decoration. In: Computational Aesthetics 2016 CAE'16, 79-88.



Creating aesthetically pleasing decorations for daily objects is a task that requires deep understanding of multiple aspects of object decoration, including color, composition and element compatibility. A designer needs a unique aesthetic style to create artworks that stand out. Although specific subproblems have been studied before, the overall problem of design recommendation and synthesis is still relatively unexplored. In this paper, we propose a flexible data-driven framework to jointly consider two aspects of this design problem: style compatibility and spatial composition. We introduce a ring-based layout model capable of capturing decorative compositions for objects like plates, vases and pots. Our layout representation allows the use of the hidden Markov models (HMM's) technique to make intelligent design suggestions for each region of a target object in a sequential fashion. We conducted both quantitative and qualitative experiments to evaluate the framework and obtained favorable results.

Extended Abstract


author = {Phan, H. Q. and Lu, J. and Asente, P. and Chan, A. B. and Fu, H.},
title = {Patternista: Learning Element Style Compatibility and Spatial Composition for Ring-based Layout Decoration},
booktitle = {Proceedings of the Joint Symposium on Computational Aesthetics and Sketch Based Interfaces and Modeling and Non-Photorealistic Animation and Rendering},
series = {Expresive '16},
year = {2016},
location = {Lisbon, Portugal},
pages = {79--88},
numpages = {10},
url = {},
ISSN = {1816-0859},
ISBN = {978-3-03868-000-0},
acmid = {2981336},
publisher = {Eurographics Association},
address = {Aire-la-Ville, Switzerland, Switzerland},

Used References

1 {ABS02} Anoshkina E. V., Belyaev A. G., Seidel H.-P.: Asymptotic analysis of three-point approximations of vertex normals and curvatures. 4

2 Sean Bell , Kavita Bala, Learning visual similarity for product design with convolutional neural networks, ACM Transactions on Graphics (TOG), v.34 n.4, August 2015

3 Christopher M. Bishop, Pattern Recognition and Machine Learning (Information Science and Statistics), Springer-Verlag New York, Inc., Secaucus, NJ, 2006

4 J Canny, A Computational Approach to Edge Detection, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.8 n.6, p.679-698, June 1986

5 Elena Garces , Aseem Agarwala , Diego Gutierrez , Aaron Hertzmann, A similarity measure for illustration style, ACM Transactions on Graphics (TOG), v.33 n.4, July 2014

6 {GB14} Gerhard H. E., Bethge M.: Towards rigorous study of artistic style: a new psychophysical paradigm. Art & Perception 2, 1-2 (2014), 23--44. 2

7 {GFRF10} Graham D. J., Friedenberg J. D., Rockmore D. N., Field D. J.: Mapping the similarity space of paintings: image statistics and visual perception. Visual Cognition 18, 4 (2010), 559--573. 2

8 {HGR10} Hughes J. M., Graham D. J., Rockmore D. N.: Quantification of artistic style through sparse coding analysis in the drawings of pieter bruegel the elder. Proceedings of the National Academy of Sciences 107, 4 (2010), 1279--1283. 2, 4

9 H.-Z. Huang , S.-H. Zhang , R. R. Martin , S.-M. Hu, Learning Natural Colors for Image Recoloring, Computer Graphics Forum, v.33 n.7, p.299-308, October 2014

10 {JJHB*08} Johnson Jr C. R., Hendriks E., Berezhnoy I. J., Brevdo E., Hughes S. M., Daubechies I., Li J., Postma E., Wang J. Z.: Image processing for artist identification. Signal Processing Magazine, IEEE 25, 4 (2008), 37--48. 2

11 Hye-Rin Kim , Min-Joon Yoo , Henry Kang , In-Kwon Lee, Perceptually-based Color Assignment, Computer Graphics Forum, v.33 n.7, p.309-318, October 2014

12 Katrin Lang , Marc Alexa, The Markov pen: online synthesis of free-hand drawing styles, Proceedings of the workshop on Non-Photorealistic Animation and Rendering, June 20-22, 2015, Istanbul, Turkey

13 Jingwan Lu , Connelly Barnes , Connie Wan , Paul Asente , Radomir Mech , Adam Finkelstein, DecoBrush: drawing structured decorative patterns by example, ACM Transactions on Graphics (TOG), v.33 n.4, July 2014

14 {LC09} Li C., Chen T.: Aesthetic visual quality assessment of paintings. Selected Topics in Signal Processing, IEEE Journal of 3, 2 (2009), 236--252. 4

15 Zhaoliang Lun , Evangelos Kalogerakis , Alla Sheffer, Elements of style: learning perceptual shape style similarity, ACM Transactions on Graphics (TOG), v.34 n.4, August 2015

16 Sharon Lin , Daniel Ritchie , Matthew Fisher , Pat Hanrahan, Probabilistic color-by-numbers: suggesting pattern colorizations using factor graphs, ACM Transactions on Graphics (TOG), v.32 n.4, July 2013

17 Peter O'Donovan , Aseem Agarwala , Aaron Hertzmann, DesignScape: Design with Interactive Layout Suggestions, Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, April 18-23, 2015, Seoul, Republic of Korea

18 {Owe00} Owen C.: Creative Ceramic Painting. 2000. 2

19 Lawrence Rabiner , Biing-Hwang Juang, Fundamentals of speech recognition, Prentice-Hall, Inc., Upper Saddle River, NJ, 1993

20 Lior Shamir , Tomasz Macura , Nikita Orlov , D. Mark Eckley , Ilya G. Goldberg, Impressionism, expressionism, surrealism: Automated recognition of painters and schools of art, ACM Transactions on Applied Perception (TAP), v.7 n.2, p.1-17, February 2010

21 Manik Varma , Andrew Zisserman, A Statistical Approach to Texture Classification from Single Images, International Journal of Computer Vision, v.62 n.1-2, p.61-81, April-May 2005

22 Ruobing Wu , Wenping Wang , Yizhou Yu, Optimized Synthesis of Art Patterns and Layered Textures, IEEE Transactions on Visualization and Computer Graphics, v.20 n.3, p.436-446, March 2014

23 Michael T. Wong , Douglas E. Zongker , David H. Salesin, Computer-generated floral ornament, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.423-434, July 1998

24 Yi-Ting Yeh , Katherine Breeden , Lingfeng Yang , Matthew Fisher , Pat Hanrahan, Synthesis of tiled patterns using factor graphs, ACM Transactions on Graphics (TOG), v.32 n.1, p.1-13, January 2013


Full Text

intern file

Sonstige Links