Non-Photorealistic Rendering of Portraits
Inhaltsverzeichnis
Reference
Paul L. Rosin and Yu-Kun Lai: Non-Photorealistic Rendering of Portraits. In: Computational Aesthetics 2015 CAE'15, 159-170.
DOI
http://dx.doi.org/10.2312/exp.20151189
Abstract
We describe an image-based non-photorealistic rendering pipeline for creating portraits in two styles: The first is a somewhat "puppet" like rendering, that treats the face like a relatively uniform smooth surface, with the geometry being emphasised by shading. The second style is inspired by the artist Julian Opie, in which the human face is reduced to its essentials, i.e. homogeneous skin, thick black lines, and facial features such as eyes and the nose represented in a cartoon manner. Our method is able to automatically generate these stylisations without requiring the input images to be tightly cropped, direct frontal view, and moreover perform abstraction while maintaining the distinctiveness of the portraits (i.e. they should remain recognisable).
Extended Abstract
Bibtex
@inproceedings{Rosin:2015:NRP:2811239.2811249,
author = {Rosin, Paul L. and Lai, Yu-Kun},
title = {Non-photorealistic Rendering of Portraits},
booktitle = {Proceedings of the Workshop on Computational Aesthetics},
series = {CAE '15},
year = {2015},
location = {Istanbul, Turkey},
pages = {159--170},
numpages = {12},
url = {http://dl.acm.org/citation.cfm?id=2811239.2811249 http://de.evo-art.org/index.php?title=Non-Photorealistic_Rendering_of_Portraits },
acmid = {2811249},
publisher = {Eurographics Association},
address = {Aire-la-Ville, Switzerland, Switzerland},
}
Used References
1 Akshay Asthana , Stefanos Zafeiriou , Shiyang Cheng , Maja Pantic, Robust Discriminative Response Map Fitting with Constrained Local Models, Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern Recognition, p.3444-3451, June 23-28, 2013 http://dl.acm.org/citation.cfm?id=2516059&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1109/CVPR.2013.442
2 Pierre Bénard , Forrester Cole , Michael Kass , Igor Mordatch , James Hegarty , Martin Sebastian Senn , Kurt Fleischer , Davide Pesare , Katherine Breeden, Stylizing animation by example, ACM Transactions on Graphics (TOG), v.32 n.4, July 2013 http://dl.acm.org/citation.cfm?id=2461929&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1145/2461912.2461929
3 S. Brooks, Mixed Media Painting and Portraiture, IEEE Transactions on Visualization and Computer Graphics, v.13 n.5, p.1041-1054, September 2007 http://dl.acm.org/citation.cfm?id=2231929&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1109/TVCG.2007.1025
4 Itamar Berger , Ariel Shamir , Moshe Mahler , Elizabeth Carter , Jessica Hodgins, Style and abstraction in portrait sketching, ACM Transactions on Graphics (TOG), v.32 n.4, July 2013 http://dl.acm.org/citation.cfm?id=2461964&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1145/2461912.2461964
5 {CEB05} Calinon S., Epiney J., Billard A.: A humanoid robot drawing human portraits. In Int. Conf. on Humanoid Robots (Humanoids) (2005), pp. 161--166. 3
6 Hong Chen , Ziqiang Liu , Chuck Rose , Yingqing Xu , Heung-Yeung Shum , David Salesin, Example-based composite sketching of human portraits, Proceedings of the 3rd international symposium on Non-photorealistic animation and rendering, June 07-09, 2004, Annecy, France http://dl.acm.org/citation.cfm?id=987673&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1145/987657.987673
7 Simon Colton , Michel F. Valstar , Maja Pantic, Emotionally aware automated portrait painting, Proceedings of the 3rd international conference on Digital Interactive Media in Entertainment and Arts, September 10-12, 2008, Athens, Greece http://dl.acm.org/citation.cfm?id=1413690&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1145/1413634.1413690
8 {GMW* 09} Gao W., Mo R., Wei L., Zhu Y., Peng Z., Zhang Y.: Template-based portrait caricature generation with facial components analysis. In Int. Conf. on Intelligent Computing and Intelligent Systems (2009), pp. 219--223. 2
9 Andrew Senior , Rein-Lien Hsu , Mohamed Abdel Mottaleb , Anil K. Jain, Face Detection in Color Images, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.24 n.5, p.696-706, May 2002 http://dl.acm.org/citation.cfm?id=513082&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1109/34.1000242
10 Christopher G. Healey , Laura Tateosian , James T. Enns , Mark Remple, Perceptually based brush strokes for nonphotorealistic visualization, ACM Transactions on Graphics (TOG), v.23 n.1, p.64-96, January 2004 http://dl.acm.org/citation.cfm?id=966135&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1145/966131.966135
11 Michael J. Jones , James M. Rehg, Statistical color models with application to skin detection, International Journal of Computer Vision, v.46 n.1, p.81-96, January 2002 http://dl.acm.org/citation.cfm?id=606260&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1023/A:1013200319198
12 Henry Kang , Seungyong Lee , Charles K. Chui, Coherent line drawing, Proceedings of the 5th international symposium on Non-photorealistic animation and rendering, August 04-05, 2007, San Diego, California http://dl.acm.org/citation.cfm?id=1274878&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1145/1274871.1274878
13 Vuong Le , Jonathan Brandt , Zhe Lin , Lubomir Bourdev , Thomas S. Huang, Interactive facial feature localization, Proceedings of the 12th European conference on Computer Vision, October 07-13, 2012, Florence, Italy http://dl.acm.org/citation.cfm?id=2403124&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1007/978-3-642-33712-3_49
14 Yu-Kun Lai , Paul L. Rosin, Efficient Circular Thresholding, IEEE Transactions on Image Processing, v.23 n.3, p.992-1001, March 2014 http://dl.acm.org/citation.cfm?id=2712295&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1109/TIP.2013.2297014
15 {MKHM07} Mar R. A., Kelley W. M., Heatherton T. F., Macrae N. C.: Detecting agency from the biological motion of veridical vs animated agents. Soc. Cogn. Affect. Neurosci. 2, 3 (2007), 199--205. 1
16 Automatic Generation of Hair Texture with Line Integral Convolution, Proceedings of the International Conference on Information Visualisation, p.303, July 19-21, 2000 http://dl.acm.org/citation.cfm?id=850455&CFID=724111209&CFTOKEN=48939661
17 {MMK* 99} Messer K., Matas J., Kittler J., Luettin J., Maitre G.: XM2VTSDB: the extended of M2VTS database. In Proc. Audio- and Video-Based Person Authentication (1999), pp. 72--77. 8
18 A. Meijster , M. H. F. Wilkinson, A Comparison of Algorithms for Connected Set Openings and Closings, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.24 n.4, p.484-494, April 2002 http://dl.acm.org/citation.cfm?id=628790&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1109/34.993556
19 Meng Meng , Mingtian Zhao , Song-Chun Zhu, Artistic paper-cut of human portraits, Proceedings of the international conference on Multimedia, October 25-29, 2010, Firenze, Italy http://dl.acm.org/citation.cfm?id=1874116&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1145/1873951.1874116
20 {PKS03} Peer P., Kovac J., Solina F.: Human skin colour clustering for face detection. In Int. Conf. on Computer as a Tool (2003), pp. 144--148. 4
21 Paul Rosin , John Collomosse, Image and Video-based Artistic Stylisation, Springer Publishing Company, Incorporated, 2012 http://dl.acm.org/citation.cfm?id=2412055&CFID=724111209&CFTOKEN=48939661
22 Carsten Rother , Vladimir Kolmogorov , Andrew Blake, "GrabCut": interactive foreground extraction using iterated graph cuts, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004 http://dl.acm.org/citation.cfm?id=1015720&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1145/1015706.1015720
23 {RL13a} Rhee C., Lee C.: Cartoon-like avatar generation using facial component matching. Int. J. of Multimedia and Ubiquitous Engineering 8, 4 (2013), 69--78. 2
24 Paul L. Rosin , Yu-Kun Lai, Artistic minimal rendering with lines and blocks, Graphical Models, v.75 n.4, p.208-229, July, 2013 http://dl.acm.org/citation.cfm?id=2486376&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1016/j.gmod.2013.03.004
25 {Sel03} Selinger P.: Potrace: a polygon-based tracing algorithm, 2003. URL: http://potrace.sourceforge.net/. 5
26 Chien-Chung Tseng , Jenn-Jier James Lien, Colored exaggerative caricature creation using inter- and intra-correlations of feature shapes and positions, Image and Vision Computing, v.30 n.1, p.15-25, January, 2012 http://dl.acm.org/citation.cfm?id=2125454&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1016/j.imavis.2011.11.006
27 Patrick Tresset , Frederic Fol Leymarie, Portrait drawing by Paul the robot, Computers and Graphics, v.37 n.5, p.348-363, August, 2013 http://dl.acm.org/citation.cfm?id=2493795&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1016/j.cag.2013.01.012
28 {WCHG13} Wang T., Collomosse J. P., Hunter A., Greig D.: Learnable stroke models for example-based portrait painting. In British Machine Vision Conference (2013), pp. 36.1--36.11. 2, 4
29 {Win13} Winnemöller H.: NPR in the wild. In Image and Video-Based Artistic Stylisation, Rosin P. L., Collomosse J. P., (Eds.). Springer, 2013, pp. 353--374. 1
30 Chenyu Wu , Ce Liu , Heung-Yueng Shum , Ying-Qing Xu , Zhengyou Zhang, Automatic Eyeglasses Removal from Face Images, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.26 n.3, p.322-336, March 2004 http://dl.acm.org/citation.cfm?id=968860&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1109/TPAMI.2004.1262319
31 J. Wu , R. R. Martin , P. L. Rosin , X. -F. Sun , Y. -K. Lai , Y. -H. Liu , C. Wallraven, Use of non-photorealistic rendering and photometric stereo in making bas-reliefs from photographs, Graphical Models, v.76 n.4, p.202-213, July, 2014 http://dl.acm.org/citation.cfm?id=2657965&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1016/j.gmod.2014.02.002
32 Jun Xie , Aaron Hertzmann , Wilmot Li , Holger Winnemöller, PortraitSketch: face sketching assistance for novices, Proceedings of the 27th annual ACM symposium on User interface software and technology, October 05-08, 2014, Honolulu, Hawaii, USA http://dl.acm.org/citation.cfm?id=2647399&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1145/2642918.2647399
33 Jie Yang , Weier Lu , Alex Waibel, Skin-Color Modeling and Adaptation, Proceedings of the Third Asian Conference on Computer Vision-Volume II, p.687-694, January 08-10, 1998 http://dl.acm.org/citation.cfm?id=722380&CFID=724111209&CFTOKEN=48939661
34 Yong Zhang , Weiming Dong , Oliver Deussen , Feiyue Huang , Ke Li , Bao-Gang Hu, Data-driven face cartoon stylization, SIGGRAPH Asia 2014 Technical Briefs, December 03-06, 2014, Shenzhen, China http://dl.acm.org/citation.cfm?id=2669028&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1145/2669024.2669028
35 Mingtian Zhao , Song-Chun Zhu, Portrait painting using active templates, Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Non-Photorealistic Animation and Rendering, August 05-07, 2011, Vancouver, British Columbia, Canada http://dl.acm.org/citation.cfm?id=2024696&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1145/2024676.2024696
Links
Full Text
http://www.researchgate.net/publication/280093554_Non-Photorealistic_Rendering_of_Portraits
Sonstige Links
http://dl.acm.org/citation.cfm?id=2811249&CFID=724111209&CFTOKEN=48939661
