Non-Photorealistic Rendering of Portraits

Aus de_evolutionary_art_org
Wechseln zu: Navigation, Suche


Paul L. Rosin and Yu-Kun Lai: Non-Photorealistic Rendering of Portraits. In: Computational Aesthetics 2015 CAE'15, 159-170.



We describe an image-based non-photorealistic rendering pipeline for creating portraits in two styles: The first is a somewhat "puppet" like rendering, that treats the face like a relatively uniform smooth surface, with the geometry being emphasised by shading. The second style is inspired by the artist Julian Opie, in which the human face is reduced to its essentials, i.e. homogeneous skin, thick black lines, and facial features such as eyes and the nose represented in a cartoon manner. Our method is able to automatically generate these stylisations without requiring the input images to be tightly cropped, direct frontal view, and moreover perform abstraction while maintaining the distinctiveness of the portraits (i.e. they should remain recognisable).

Extended Abstract


author = {Rosin, Paul L. and Lai, Yu-Kun},
title = {Non-photorealistic Rendering of Portraits},
booktitle = {Proceedings of the Workshop on Computational Aesthetics},
series = {CAE '15},
year = {2015},
location = {Istanbul, Turkey},
pages = {159--170},
numpages = {12},
url = { },
acmid = {2811249},
publisher = {Eurographics Association},
address = {Aire-la-Ville, Switzerland, Switzerland},

Used References

1 Akshay Asthana , Stefanos Zafeiriou , Shiyang Cheng , Maja Pantic, Robust Discriminative Response Map Fitting with Constrained Local Models, Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern Recognition, p.3444-3451, June 23-28, 2013

2 Pierre Bénard , Forrester Cole , Michael Kass , Igor Mordatch , James Hegarty , Martin Sebastian Senn , Kurt Fleischer , Davide Pesare , Katherine Breeden, Stylizing animation by example, ACM Transactions on Graphics (TOG), v.32 n.4, July 2013

3 S. Brooks, Mixed Media Painting and Portraiture, IEEE Transactions on Visualization and Computer Graphics, v.13 n.5, p.1041-1054, September 2007

4 Itamar Berger , Ariel Shamir , Moshe Mahler , Elizabeth Carter , Jessica Hodgins, Style and abstraction in portrait sketching, ACM Transactions on Graphics (TOG), v.32 n.4, July 2013

5 {CEB05} Calinon S., Epiney J., Billard A.: A humanoid robot drawing human portraits. In Int. Conf. on Humanoid Robots (Humanoids) (2005), pp. 161--166. 3

6 Hong Chen , Ziqiang Liu , Chuck Rose , Yingqing Xu , Heung-Yeung Shum , David Salesin, Example-based composite sketching of human portraits, Proceedings of the 3rd international symposium on Non-photorealistic animation and rendering, June 07-09, 2004, Annecy, France

7 Simon Colton , Michel F. Valstar , Maja Pantic, Emotionally aware automated portrait painting, Proceedings of the 3rd international conference on Digital Interactive Media in Entertainment and Arts, September 10-12, 2008, Athens, Greece

8 {GMW* 09} Gao W., Mo R., Wei L., Zhu Y., Peng Z., Zhang Y.: Template-based portrait caricature generation with facial components analysis. In Int. Conf. on Intelligent Computing and Intelligent Systems (2009), pp. 219--223. 2

9 Andrew Senior , Rein-Lien Hsu , Mohamed Abdel Mottaleb , Anil K. Jain, Face Detection in Color Images, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.24 n.5, p.696-706, May 2002

10 Christopher G. Healey , Laura Tateosian , James T. Enns , Mark Remple, Perceptually based brush strokes for nonphotorealistic visualization, ACM Transactions on Graphics (TOG), v.23 n.1, p.64-96, January 2004

11 Michael J. Jones , James M. Rehg, Statistical color models with application to skin detection, International Journal of Computer Vision, v.46 n.1, p.81-96, January 2002

12 Henry Kang , Seungyong Lee , Charles K. Chui, Coherent line drawing, Proceedings of the 5th international symposium on Non-photorealistic animation and rendering, August 04-05, 2007, San Diego, California

13 Vuong Le , Jonathan Brandt , Zhe Lin , Lubomir Bourdev , Thomas S. Huang, Interactive facial feature localization, Proceedings of the 12th European conference on Computer Vision, October 07-13, 2012, Florence, Italy

14 Yu-Kun Lai , Paul L. Rosin, Efficient Circular Thresholding, IEEE Transactions on Image Processing, v.23 n.3, p.992-1001, March 2014

15 {MKHM07} Mar R. A., Kelley W. M., Heatherton T. F., Macrae N. C.: Detecting agency from the biological motion of veridical vs animated agents. Soc. Cogn. Affect. Neurosci. 2, 3 (2007), 199--205. 1

16 Automatic Generation of Hair Texture with Line Integral Convolution, Proceedings of the International Conference on Information Visualisation, p.303, July 19-21, 2000

17 {MMK* 99} Messer K., Matas J., Kittler J., Luettin J., Maitre G.: XM2VTSDB: the extended of M2VTS database. In Proc. Audio- and Video-Based Person Authentication (1999), pp. 72--77. 8

18 A. Meijster , M. H. F. Wilkinson, A Comparison of Algorithms for Connected Set Openings and Closings, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.24 n.4, p.484-494, April 2002

19 Meng Meng , Mingtian Zhao , Song-Chun Zhu, Artistic paper-cut of human portraits, Proceedings of the international conference on Multimedia, October 25-29, 2010, Firenze, Italy

20 {PKS03} Peer P., Kovac J., Solina F.: Human skin colour clustering for face detection. In Int. Conf. on Computer as a Tool (2003), pp. 144--148. 4

21 Paul Rosin , John Collomosse, Image and Video-based Artistic Stylisation, Springer Publishing Company, Incorporated, 2012

22 Carsten Rother , Vladimir Kolmogorov , Andrew Blake, "GrabCut": interactive foreground extraction using iterated graph cuts, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004

23 {RL13a} Rhee C., Lee C.: Cartoon-like avatar generation using facial component matching. Int. J. of Multimedia and Ubiquitous Engineering 8, 4 (2013), 69--78. 2

24 Paul L. Rosin , Yu-Kun Lai, Artistic minimal rendering with lines and blocks, Graphical Models, v.75 n.4, p.208-229, July, 2013

25 {Sel03} Selinger P.: Potrace: a polygon-based tracing algorithm, 2003. URL: 5

26 Chien-Chung Tseng , Jenn-Jier James Lien, Colored exaggerative caricature creation using inter- and intra-correlations of feature shapes and positions, Image and Vision Computing, v.30 n.1, p.15-25, January, 2012

27 Patrick Tresset , Frederic Fol Leymarie, Portrait drawing by Paul the robot, Computers and Graphics, v.37 n.5, p.348-363, August, 2013

28 {WCHG13} Wang T., Collomosse J. P., Hunter A., Greig D.: Learnable stroke models for example-based portrait painting. In British Machine Vision Conference (2013), pp. 36.1--36.11. 2, 4

29 {Win13} Winnemöller H.: NPR in the wild. In Image and Video-Based Artistic Stylisation, Rosin P. L., Collomosse J. P., (Eds.). Springer, 2013, pp. 353--374. 1

30 Chenyu Wu , Ce Liu , Heung-Yueng Shum , Ying-Qing Xu , Zhengyou Zhang, Automatic Eyeglasses Removal from Face Images, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.26 n.3, p.322-336, March 2004

31 J. Wu , R. R. Martin , P. L. Rosin , X. -F. Sun , Y. -K. Lai , Y. -H. Liu , C. Wallraven, Use of non-photorealistic rendering and photometric stereo in making bas-reliefs from photographs, Graphical Models, v.76 n.4, p.202-213, July, 2014

32 Jun Xie , Aaron Hertzmann , Wilmot Li , Holger Winnemöller, PortraitSketch: face sketching assistance for novices, Proceedings of the 27th annual ACM symposium on User interface software and technology, October 05-08, 2014, Honolulu, Hawaii, USA

33 Jie Yang , Weier Lu , Alex Waibel, Skin-Color Modeling and Adaptation, Proceedings of the Third Asian Conference on Computer Vision-Volume II, p.687-694, January 08-10, 1998

34 Yong Zhang , Weiming Dong , Oliver Deussen , Feiyue Huang , Ke Li , Bao-Gang Hu, Data-driven face cartoon stylization, SIGGRAPH Asia 2014 Technical Briefs, December 03-06, 2014, Shenzhen, China

35 Mingtian Zhao , Song-Chun Zhu, Portrait painting using active templates, Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Non-Photorealistic Animation and Rendering, August 05-07, 2011, Vancouver, British Columbia, Canada


Full Text

intern file

Sonstige Links