Neural style transfer: a paradigm shift for image-based artistic rendering?

Aus de_evolutionary_art_org
Wechseln zu: Navigation, Suche

Referenz

Amir Semmo Tobias Isenberg Jürgen Döllner: Neural style transfer: a paradigm shift for image-based artistic rendering?

DOI

https://doi.org/10.1145/3092919.3092920

Abstract

In this meta paper we discuss image-based artistic rendering (IB-AR) based on neural style transfer (NST) and argue, while NST may represent a paradigm shift for IB-AR, that it also has to evolve as an interactive tool that considers the design aspects and mechanisms of artwork production. IB-AR received significant attention in the past decades for visual communication, covering a plethora of techniques to mimic the appeal of artistic media. Example-based rendering represents one the most promising paradigms in IB-AR to (semi-)automatically simulate artistic media with high fidelity, but so far has been limited because it relies on pre-defined image pairs for training or informs only low-level image features for texture transfers. Advancements in deep learning showed to alleviate these limitations by matching content and style statistics via activations of neural network layers, thus making a generalized style transfer practicable. We categorize style transfers within the taxonomy of IB-AR, then propose a semiotic structure to derive a technical research agenda for NSTs with respect to the grand challenges of NPAR. We finally discuss the potentials of NSTs, thereby identifying applications such as casual creativity and art production.

Extended Abstract

Bibtex

@inproceedings{Semmo:2017:NST:3092919.3092920,
author = {Semmo, Amir and Isenberg, Tobias and D\"{o}llner, J\"{u}rgen},
title = {Neural Style Transfer: A Paradigm Shift for Image-based Artistic Rendering?},
booktitle = {Proceedings of the Symposium on Non-Photorealistic Animation and Rendering},
series = {NPAR '17},
year = {2017},
isbn = {978-1-4503-5081-5},
location = {Los Angeles, California},
pages = {5:1--5:13},
articleno = {5},
numpages = {13},
url = {http://doi.acm.org/10.1145/3092919.3092920 http://de.evo-art.org/index.php?title=Neural_style_transfer:_a_paradigm_shift_for_image-based_artistic_rendering%3F},
doi = {10.1145/3092919.3092920},
acmid = {3092920},
publisher = {ACM},
address = {New York, NY, USA},
keywords = {convolutional neural networks, image processing, image-based artistic rendering, semiotics, style transfer, stylization},
}

Used References

1 Pierre Bénard, Adrien Bousseau, and Joëlle Thollot. 2011. State-of-the-Art Report on Temporal Coherence for Stylized Animations. Computer Graphics Forum 30, 8 (Dec. 2011), 2367--2386. http://dx.doi.org/10.1111/j.1467-8659.2011.02075.x

2 Jacques Bertin. 2010. Semiology of Graphics: Diagrams, Networks, Maps. Esri Press, Redlands, California. http://esripress.esri.com/display/index.cfm?fuseaction=display&websiteID=190

3 Doug DeCarlo , Anthony Santella, Stylization and abstraction of photographs, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002 https://dl.acm.org/citation.cfm?id=566650&CFID=558819604&CFTOKEN=68186175 http://doi.acm.org/10.1145/566654.566650

4 Kapil Dev, Mobile Expressive Renderings: The State of the Art, IEEE Computer Graphics and Applications, v.33 n.3, p.22-31, May 2013 https://dl.acm.org/citation.cfm?id=2511890&CFID=558819604&CFTOKEN=68186175 http://dx.doi.org/10.1109/MCG.2013.20

5 James J. DiCarlo, Davide Zoccolan, and Nicole C. Rust. 2012. How Does the Brain Solve Visual Object Recognition? Neuron 73, 3 (Feb. 2012), 415--434. http://dx.doi.org/10.1016/j.neuron.2012.01.010

6 Hasan Sheikh Faridul, Tania Pouli, Christel Chamaret, Jürgen Stauder, Alain Trémeau, and Erik Reinhard. 2014. A Survey of Color Mapping and its Applications. In Eurographics State of the Art Reports. Eurographics Association, Goslar, Germany, 43--67. http://dx.doi.org/10.2312/egst.20141035

7 Amy A. Gooch, Towards mapping the field of non-photorealistic rendering, Proceedings of the 8th International Symposium on Non-Photorealistic Animation and Rendering, June 07-10, 2010, Annecy, France https://dl.acm.org/citation.cfm?id=1809958&CFID=558819604&CFTOKEN=68186175 http://doi.acm.org/10.1145/1809939.1809958

8 Amy A. Gooch , Jeremy Long , Li Ji , Anthony Estey , Bruce S. Gooch, Viewing progress in non-photorealistic rendering through Heinlein's lens, Proceedings of the 8th International Symposium on Non-Photorealistic Animation and Rendering, June 07-10, 2010, Annecy, France https://dl.acm.org/citation.cfm?id=1809959&CFID=558819604&CFTOKEN=68186175 http://doi.acm.org/10.1145/1809939.1809959

9 Peter Hall and Ann-Sophie Lehmann. 2013. Don't Measure---Appreciate! NPR Seen Through the Prism of Art History. In Image and Video based Artistic Stylisation, Paul Rosin and John Collomosse (Eds.). Computational Imaging and Vision, vol. 42. Springer, London/Heidelberg, Chapter 16, 333--351. http://dx.doi.org/10.1007/978-1-4471-4519-6_16

10 Nick Halper, Mara Mellin, Christoph S. Herrmann, Volker Linneweber, and Thomas Strothotte. 2003. Psychology and Non-Photorealistic Rendering: The Beginning of a Beautiful Relationship. In Proc. Mensch & Computer. Teubner Verlag, Wiesbaden, 277--286. http://dx.doi.org/10.1007/978-3-322-80058-9_28

11 Aaron Hertzmann, Non-Photorealistic Rendering and the science of art, Proceedings of the 8th International Symposium on Non-Photorealistic Animation and Rendering, June 07-10, 2010, Annecy, France https://dl.acm.org/citation.cfm?id=1809957&CFID=558819604&CFTOKEN=68186175 http://doi.acm.org/10.1145/1809939.1809957

12 Tobias Isenberg. 2013. Evaluating and Validating Non-Photorealistic and Illustrative Rendering. In Image and Video based Artistic Stylisation, Paul Rosin and John Collomosse (Eds.). Computational Imaging and Vision, Vol. 42. Springer, London/Heidelberg, Chapter 15, 311--331. http://dx.doi.org/10.1007/978-1-4471-4519-6_15

13 Tobias Isenberg. 2016. Interactive NPAR: What Type of Tools Should We Create?. In Proc. NPAR. Eurographics Association, Goslar, Germany, 89--96. http://dx.doi.org/10.2312/exp.20161067

14 Jan Eric Kyprianidis , John Collomosse , Tinghuai Wang , Tobias Isenberg, State of the "Art”: A Taxonomy of Artistic Stylization Techniques for Images and Video, IEEE Transactions on Visualization and Computer Graphics, v.19 n.5, p.866-885, May 2013 https://dl.acm.org/citation.cfm?id=2479163&CFID=558819604&CFTOKEN=68186175 http://dx.doi.org/10.1109/TVCG.2012.160

15 Jan Eric Kyprianidis and Jürgen Döllner. 2008. Image Abstraction by Structure Adaptive Filtering. In Proc. TP.CG. Eurographics Association, Goslar, Germany, 51--58. http://dx.doi.org/10.2312/LocalChapterEvents/TPCG/TPCG08/051-058

16 John Lansdown , Simon Schofield, Expressive Rendering: A Review of Nonphotorealistic Techniques, IEEE Computer Graphics and Applications, v.15 n.3, p.29-37, May 1995 https://dl.acm.org/citation.cfm?id=618268&CFID=558819604&CFTOKEN=68186175 http://dx.doi.org/10.1109/38.376610

17 Kwan-Liu Ma (Ed.). 2002. Recent Advances in Non-Photorealistic Rendering for Art and Visualization. SIGGRAPH Course Notes, vol. 23. ACM, New York. http://www.cs.ucdavis.edu/~ma/SIGGRAPH02/course23/

18 Alan M. MacEachren. 1995. How Maps Work: Representation, Visualization, and Design. Guilford Press, New York. https://www.abebooks.com/products/isbn/9780898625899

19 Alan M. MacEachren , Robert E. Roth , James O'Brien , Bonan Li , Derek Swingley , Mark Gahegan, Visual Semiotics & Uncertainty Visualization: An Empirical Study, IEEE Transactions on Visualization and Computer Graphics, v.18 n.12, p.2496-2505, December 2012 https://dl.acm.org/citation.cfm?id=2720405&CFID=558819604&CFTOKEN=68186175 http://dx.doi.org/10.1109/TVCG.2012.279

20 Domingo Martín, Germán Arroyo, Alejandro Rodríguez, and Tobias Isenberg. 2017. A Survey of Digital Stippling. Computers & Graphics (2017). To appear. http://dx.doi.org/10.1016/j.cag.2017.05.001

21 David Mould and Paul L. Rosin. 2016. A Benchmark Image Set for Evaluating Stylization. In Proc. NPAR. Eurographics Association, Goslar, Germany, 11--20. http://dx.doi.org/10.2312/exp.20161059

22 Peter Rautek, Stefan Bruckner, Eduard Gröller, and Ivan Viola. 2008. Illustrative Visualization: New Technology or Useless Tautology? ACM SIGGRAPH Computer Graphics 42, 3, Article 4 (Aug. 2008), 8 pages. http://doi.acm.org/10.1145/1408626.1408633

23 Paul Rosin and John Collomosse (Eds.). 2013. Image and Video based Artistic Stylisation. Computational Imaging and Vision, Vol. 42. Springer, London/Heidelberg. http://dx.doi.org/10.1007/978-1-4471-4519-6

24 Richard Rudner. 1951. On Semiotic Aesthetics. The Journal of Aesthetics and Art Criticism 10, 1 (Sept. 1951), 67--77. http://dx.doi.org/10.2307/426789

25 David H. Salesin. 2002. Non-Photorealistic Animation & Rendering: 7 Grand Challenges. Keynote talk at NPAR. (June 2002).

26 Meyer Schapiro. 1994. Theory and Philosophy of Art: Style, Artist, and Society. Vol. 4. George Braziller, New York.

27 Holger Winnemöller. 2013. NPR in the Wild. In Image and Video based Artistic Stylisation, Paul Rosin and John Collomosse (Eds.). Computational Imaging and Vision, vol. 42. Springer, London/Heidelberg, Chapter 17, 353--374. http://dx.doi.org/10.1007/978-1-4471-4519-6_17

28 Benoit Arbelot, Romain Vergne, Thomas Hurtut, and Joëlle Thollot. 2016. Automatic Texture Guided Color Transfer and Colorization. In Proc. NPAR. Eurographics Association, Goslar, Germany, 21--32. http://dx.doi.org/10.2312/exp.20161060

29 Huiwen Chang, Ohad Fried, Yiming Liu, Stephen DiVerdi, and Adam Finkelstein. 2015. Palette-based Photo Recoloring. ACM Transactions on Graphics 34, 4, Article 139 (July 2015), 11 pages. http://doi.acm.org/10.1145/2766978

30 SungYe Kim, Ross Maciejewski, Tobias Isenberg, William M. Andrews, Wei Chen, Mario Costa Sousa, and David S. Ebert. 2009. Stippling by Example. In Proc. NPAR. ACM, New York, 41--50. http://doi.acm.org/10.1145/1572614.1572622

31 Ross Maciejewski , Tobias Isenberg , William M. Andrews , David S. Ebert , Mario Costa Sousa , Wei Chen, Measuring Stipple Aesthetics in Hand-Drawn and Computer-Generated Images, IEEE Computer Graphics and Applications, v.28 n.2, p.62-74, March 2008 https://dl.acm.org/citation.cfm?id=1399143&CFID=558819604&CFTOKEN=68186175 http://dx.doi.org/10.1109/MCG.2008.35

32 Domingo MartíN , GermáN Arroyo , M. Victoria LuzóN , Tobias Isenberg, Extended papers from NPAR 2010: Scale-dependent and example-based grayscale stippling, Computers and Graphics, v.35 n.1, p.160-174, February, 2011 https://dl.acm.org/citation.cfm?id=1937416&CFID=558819604&CFTOKEN=68186175 http://dx.doi.org/10.1016/j.cag.2010.11.006

33 Attila Neumann and László Neumann. 2005. Color Style Transfer Techniques using Hue, Lightness and Saturation Histogram Matching. In Proc. CAe. Eurographics Association, Goslar, Germany, 111--122. http://dx.doi.org/10.2312/COMPAESTH/COMPAESTH05/111-122

34 Tania Pouli , Erik Reinhard, Extended papers from NPAR 2010: Progressive color transfer for images of arbitrary dynamic range, Computers and Graphics, v.35 n.1, p.67-80, February, 2011 https://dl.acm.org/citation.cfm?id=1937406&CFID=558819604&CFTOKEN=68186175 http://dx.doi.org/10.1016/j.cag.2010.11.003

35 Erik Reinhard , Michael Ashikhmin , Bruce Gooch , Peter Shirley, Color Transfer between Images, IEEE Computer Graphics and Applications, v.21 n.5, p.34-41, September 2001 https://dl.acm.org/citation.cfm?id=618848&CFID=558819604&CFTOKEN=68186175 http://dx.doi.org/10.1109/38.946629

36 Yi-Chian Wu , Yu-Ting Tsai , Wen-Chieh Lin , Wen-Hsin Li, Generating pointillism paintings based on Seurat's color composition, Proceedings of the Eurographics Symposium on Rendering, June 19-21, 2013, Zaragoza, Spain https://dl.acm.org/citation.cfm?id=2600914&CFID=558819604&CFTOKEN=68186175 http://dx.doi.org/10.1111/cgf.12161

37 Xuezhong Xiao and Lizhuang Ma. 2009. Gradient-Preserving Color Transfer. Computer Graphics Forum 28, 7 (Oct. 2009), 1879--1886. http://dx.doi.org/10.1111/j.1467-8659.2009.01566.x

38 Yue Yang , Hanli Zhao , Lihua You , Renlong Tu , Xueyi Wu , Xiaogang Jin, Semantic portrait color transfer with internet images, Multimedia Tools and Applications, v.76 n.1, p.523-541, January 2017 https://dl.acm.org/citation.cfm?id=3048193&CFID=558819604&CFTOKEN=68186175 http://dx.doi.org/10.1007/s11042-015-3063-x

39 Michael Ashikhmin, Fast Texture Transfer, IEEE Computer Graphics and Applications, v.23 n.4, p.38-43, July 2003 https://dl.acm.org/citation.cfm?id=858655&CFID=558819604&CFTOKEN=68186175 http://dx.doi.org/10.1109/MCG.2003.1210863

40 Pierre Bénard, Forrester Cole, Michael Kass, Igor Mordatch, James Hegarty, Martin Sebastian Senn, Kurt Fleischer, Davide Pesare, and Katherine Breeden. 2013. Stylizing Animation by Example. ACM Transactions on Graphics 32, 4, Article 119 (July 2013), 12 pages. http://doi.acm.org/10.1145/2461912.2461929

41 Itamar Berger, Ariel Shamir, Moshe Mahler, Elizabeth Carter, and Jessica Hodgins. 2013. Style and Abstraction in Portrait Sketching. ACM Transactions on Graphics 32, 4, Article 55 (July 2013), 12 pages. http://doi.acm.org/10.1145/2461912.2461964

42 Alexei A. Efros , William T. Freeman, Image quilting for texture synthesis and transfer, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.341-346, August 2001 https://dl.acm.org/citation.cfm?id=383296&CFID=558819604&CFTOKEN=68186175 http://doi.acm.org/10.1145/383259.383296

43 Jakub Fišer, Ondřej Jamriška, Michal Lukáč, Eli Shechtman, Paul Asente, Jingwan Lu, and Daniel Sýkora. 2016. StyLit: Illumination-guided Example-based Stylization of 3D Renderings. ACM Transactions on Graphics 35, 4, Article 92 (July 2016), 11 pages. http://doi.acm.org/10.1145/2897824.2925948

44 Ryota Hashimoto, Henry Johan, and Tomoyuki Nishita. 2003. Creating Various Styles of Animations Using Example-Based Filtering. In Proc. CGI. IEEE Computer Society, Los Alamitos, 312--317. http://dx.doi.org/10.1109/CGI.2003.1214488

45 Aaron Hertzmann , Charles E. Jacobs , Nuria Oliver , Brian Curless , David H. Salesin, Image analogies, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.327-340, August 2001 https://dl.acm.org/citation.cfm?id=383295&CFID=558819604&CFTOKEN=68186175 http://doi.acm.org/10.1145/383259.383295

46 Aaron Hertzmann, Nuria Oliver, Brian Curles, and Steven M. Seitz. 2002. Curve Analogies. In Proc. EGWR. Eurographics Association, Goslar, Germany, 233--246. http://dx.doi.org/10.2312/EGWR/EGWR02/233-246

47 Bhautik Joshi, Kristen Stewart, and David Shapiro. 2017. Bringing Impressionism to Life with Neural Style Transfer in Come Swim. arXiv.org report 1701.04928. https://arxiv.org/abs/1701.04928

48 Hochang Lee , Sanghyun Seo , Kyunghyun Yoon, Extended papers from NPAR 2010: Directional texture transfer with edge enhancement, Computers and Graphics, v.35 n.1, p.81-91, February, 2011 https://dl.acm.org/citation.cfm?id=1937409&CFID=558819604&CFTOKEN=68186175 http://dx.doi.org/10.1016/j.cag.2010.11.008

49 Tinghuai Wang, John Collomosse, Andrew Hunter, and Darryl Greig. 2013. Learnable Stroke Models for Example-based Portrait Painting. In Proc. British Machine Vision Conference. BMVA Press, Durham, UK, Article 36, 11 pages. http://dx.doi.org/10.5244/C.27.36

50 Mingtian Zhao , Song-Chun Zhu, Portrait painting using active templates, Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Non-Photorealistic Animation and Rendering, August 05-07, 2011, Vancouver, British Columbia, Canada https://dl.acm.org/citation.cfm?id=2024696&CFID=558819604&CFTOKEN=68186175 http://doi.acm.org/10.1145/2024676.2024696

51 Alexander G. Anderson, Cory P. Berg, Daniel P. Mossing, and Bruno A. Olshausen. 2016. DeepMovie: Using Optical Flow and Deep Neural Networks to Stylize Movies. arXiv.org report 1607.08022. https://arxiv.org/abs/1605.08153

52 Federico Becattini, Andrea Ferracani, Lea Landucci, Daniele Pezzatini, Tiberio Uricchio, and Alberto Del Bimbo. 2016. Imaging Novecento. A Mobile App for Automatic Recognition of Artworks and Transfer of Artistic Styles. In Proc. EuroMed. Springer International, Cham, Switzerland, 781--791. http://dx.doi.org/10.1007/978-3-319-48496-9_62

53 Alex J. Champandard. 2016. Semantic Style Transfer and Turning Two-Bit Doodles into Fine Artworks. arXiv.org report 1612.04337. https://arxiv.org/abs/1603.01768

54 Tian Q. Chen and Mark Schmidt. 2016. Fast Patch-based Style Transfer of Arbitrary Style. arXiv.org report 1612.04337. https://arxiv.org/abs/1612.04337

55 Vincent Dumoulin, Jonathon Shlens, and Manjunath Kudlur. 2017. A Learned Representation For Artistic Style. arXiv.org report 1610.07629. https://arxiv.org/abs/1610.07629

56 Leon A. Gatys, Matthias Bethge, Aaron Hertzmann, and Eli Shechtman. 2016a. Preserving Color in Neural Artistic Style Transfer. arXiv.org report 1606.05897. https://arxiv.org/abs/1606.05897

57 Leon A. Gatys, Alexander S. Ecker, and Matthias Bethge. 2016b. Image Style Transfer Using Convolutional Neural Networks. In Proc. CVPR. IEEE Computer Society, Los Alamitos, 2414--2423. http://dx.doi.org/10.1109/CVPR.2016.265

58 Leon A. Gatys, Alexander S. Ecker, Matthias Bethge, Aaron Hertzmann, and Eli Shechtman. 2016c. Controlling Perceptual Factors in Neural Style Transfer. arXiv.org report 1611.07865. https://arxiv.org/abs/1611.07865

59 L. A. Gatys, A. S. Ecker, M. Bethge, A. Hertzmann, and E. Shechtman. 2017. Controlling Perceptual Factors in Neural Style Transfer. In Proc. CVPR. IEEE Computer Society, Los Alamitos. To appear.

60 Agrim Gupta, Justin Johnson, Alexandre Alahi, and Li Fei-Fei. 2017. Characterizing and Improving Stability in Neural Style Transfer. arXiv.org report 1705.02092. https://arxiv.org/abs/1705.02092

61 Xun Huang and Serge Belongie. 2017. Arbitrary Style Transfer in Real-time with Adaptive Instance Normalization. arXiv.org report 1703.06868. https://arxiv.org/abs/1703.06868

62 Satoshi Iizuka, Edgar Simo-Serra, and Hiroshi Ishikawa. 2016. Let There Be Color!: Joint End-to-end Learning of Global and Local Image Priors for Automatic Image Colorization with Simultaneous Classification. ACM Transactions on Graphics 35, 4, Article 110 (July 2016), 11 pages. http://doi.acm.org/10.1145/2897824.2925974

63 Justin Johnson, Alexandre Alahi, and Li Fei-Fei. 2016a. Perceptual Losses for Real-Time Style Transfer and Super-Resolution. In Proc. ECCV. Springer International, Cham, Switzerland, 694--711. http://dx.doi.org/10.1007/978-3-319-46475-6_43

64 Justin Johnson, Alexandre Alahi, and Fei-Fei Li. 2016b. Perceptual Losses for Real-Time Style Transfer and Super-Resolution. arXiv.org report 1603.08155. https://arxiv.org/abs/1603.08155

65 Chuan Li and Michael Wand. 2016. Combining Markov Random Fields and Convolutional Neural Networks for Image Synthesis. In Proc. CVPR. IEEE Computer Society, Los Alamitos, 2479--2486. http://dx.doi.org/10.1109/CVPR.2016.272

66 X. Liu, Paul L. Rosin, Yu-Kun Lai, and M.-M. Cheng. 2017. Depth-Aware Neural Style Transfer. In Proc. NPAR. ACM, New York. To appear (this proceedings).

67 Eric Risser, Pierre Wilmot, and Connelly Barnes. 2017. Stable and Controllable Neural Texture Synthesis and Style Transfer Using Histogram Losses. arXiv.org report 1701.08893. https://arxiv.org/abs/1607.08022

68 Manuel Ruder, Alexey Dosovitskiy, and Thomas Brox. 2016. Artistic Style Transfer for Videos. In Proc. GCPR. Springer International, Cham, Switzerland, 26--36. http://dx.doi.org/10.1007/978-3-319-45886-1_3

69 Ahmed Selim, Mohamed Elgharib, and Linda Doyle. 2016. Painting Style Transfer for Head Portraits Using Convolutional Neural Networks. ACM Transactions on Graphics 35, 4, Article 129 (July 2016), 18 pages. http://doi.acm.org/10.1145/2897824.2925968

70 Yaniv Taigman, Adam Polyak, and Lior Wolf. 2016. Unsupervised Cross-Domain Image Generation. arXiv.org report 1611.02200. https://arxiv.org/abs/1611.02200

71 Dmitry Ulyanov, Vadim Lebedev, Andrea Vedaldi, and Victor S. Lempitsky. 2016a. Texture Networks: Feed-forward Synthesis of Textures and Stylized Images. In Proc. International Conference on Machine Learning. JMLR.org, New York, 1349--1357. http://jmlr.org/proceedings/papers/v48/ulyanov16.html

72 Dmitry Ulyanov, Andrea Vedaldi, and Victor Lempitsky. 2017a. Improved Texture Networks: Maximizing Quality and Diversity in Feed-forward Stylization and Texture Synthesis. In Proc. CVPR. IEEE Computer Society, Los Alamitos. To appear.

73 Dmitry Ulyanov, Andrea Vedaldi, and Victor Lempitsky. 2017b. Improved Texture Networks: Maximizing Quality and Diversity in Feed-forward Stylization and Texture Synthesis. arXiv.org report 1701.02096. https://arxiv.org/abs/1701.02096

74 Dmitry Ulyanov, Andrea Vedaldi, and Victor S. Lempitsky. 2016b. Instance Normalization: The Missing Ingredient for Fast Stylization. arXiv.org report 1607.08022. https://arxiv.org/abs/1607.08022

75 Hang Zhang and Kristin Dana. 2017. Multi-style Generative Network for Real-time Transfer. arXiv.org report 1703.06953. https://arxiv.org/abs/1703.06953

76 Adrien Bousseau , Matt Kaplan , Joëlle Thollot , François X. Sillion, Interactive watercolor rendering with temporal coherence and abstraction, Proceedings of the 4th international symposium on Non-photorealistic animation and rendering, June 05-07, 2006, Annecy, France https://dl.acm.org/citation.cfm?id=1124751&CFID=558819604&CFTOKEN=68186175 http://doi.acm.org/10.1145/1124728.1124751

77 Forrester Cole , Aleksey Golovinskiy , Alex Limpaecher , Heather Stoddart Barros , Adam Finkelstein , Thomas Funkhouser , Szymon Rusinkiewicz, Where do people draw lines?, ACM SIGGRAPH 2008 papers, August 11-15, 2008, Los Angeles, California https://dl.acm.org/citation.cfm?id=1360687&CFID=558819604&CFTOKEN=68186175 http://doi.acm.org/10.1145/1360612.1360687

78 Christopher DeCoro , Forrester Cole , Adam Finkelstein , Szymon Rusinkiewicz, Stylized shadows, Proceedings of the 5th international symposium on Non-photorealistic animation and rendering, August 04-05, 2007, San Diego, California https://dl.acm.org/citation.cfm?id=1274884&CFID=558819604&CFTOKEN=68186175 http://doi.acm.org/10.1145/1274871.1274884

79 Maarten H. Everts, Henk Bekker, Jos B.T. M. Roerdink, and Tobias Isenberg. 2015. Interactive Illustrative Line Styles and Line Style Transfer Functions for Flow Visualization. arXiv.org report 1503.05787. https://www.arxiv.org/abs/1503.05787

80 Moritz Gerl and Tobias Isenberg. 2013. Interactive Example-based Hatching. Computers & Graphics 37, 1--2 (Feb.--April 2013), 65--80. http://dx.doi.org/10.1016/j.cag.2012.11.003

81 Aaron Hertzmann, Painterly rendering with curved brush strokes of multiple sizes, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.453-460, July 1998 https://dl.acm.org/citation.cfm?id=280951&CFID=558819604&CFTOKEN=68186175 http://doi.acm.org/10.1145/280814.280951

82 Aaron Hertzmann, Fast paint texture, Proceedings of the 2nd international symposium on Non-photorealistic animation and rendering, June 03-05, 2002, Annecy, France https://dl.acm.org/citation.cfm?id=508546&CFID=558819604&CFTOKEN=68186175 http://doi.acm.org/10.1145/508530.508546

83 Tobias Isenberg , Petra Neumann , Sheelagh Carpendale , Mario Costa Sousa , Joaquim A. Jorge, Non-photorealistic rendering in context: an observational study, Proceedings of the 4th international symposium on Non-photorealistic animation and rendering, June 05-07, 2006, Annecy, France https://dl.acm.org/citation.cfm?id=1124747&CFID=558819604&CFTOKEN=68186175 http://doi.acm.org/10.1145/1124728.1124747

84 Alex Krizhevsky, Ilya Sutskever, and Geoffrey E. Hinton. 2012. ImageNet Classification with Deep Convolutional Neural Networks. In Advances in Neural Information Processing Systems (NIPS). Curran Associates, Inc., Red Hook, NY, USA, 1097--1105. https://papers.nips.cc/paper/4824-imagenet-classification-with-deep-convolutional-neural-networks

85 Hyunjun Lee , Sungtae Kwon , Seungyong Lee, Real-time pencil rendering, Proceedings of the 4th international symposium on Non-photorealistic animation and rendering, June 05-07, 2006, Annecy, France https://dl.acm.org/citation.cfm?id=1124735&CFID=558819604&CFTOKEN=68186175 http://doi.acm.org/10.1145/1124728.1124735

86 Tsung-Yi Lin, Michael Maire, Serge Belongie, James Hays, Pietro Perona, Deva Ramanan, Piotr Dollár, and C. Lawrence Zitnick. 2014. Microsoft COCO: Common Objects in Context. In Proc. ECCV. Springer International, Cham, Switzerland, 740--755. http://dx.doi.org/10.1007/978-3-319-10602-1_48

87 Lukasz Mackiewicz and Francho Melendez. 2016. Loving Vincent: Guiding Painters Through 64.000 Frames. In SIGGRAPH Talks. ACM, New York, Article 6, 2 pages. http://doi.acm.org/10.1145/2897839.2927394

88 Domingo Martín, Vicente del Sol, Celia Romo, and Tobias Isenberg. 2015. Drawing Characteristics for Reproducing Traditional Hand-Made Stippling. In Proc. NPAR. Eurographics Association, Goslar, Germany, 103--115. http://dx.doi.org/10.2312/exp.20151183

89 Parag K. Mital , Mick Grierson , Tim J. Smith, Corpus-based visual synthesis: an approach for artistic stylization, Proceedings of the ACM Symposium on Applied Perception, August 22-23, 2013, Dublin, Ireland https://dl.acm.org/citation.cfm?id=2492505&CFID=558819604&CFTOKEN=68186175 http://doi.acm.org/10.1145/2492494.2492505

90 Santiago E. Montesdeoca, Hock-Soon Seah, and Hans-Martin Rall. 2016. Art-directed Watercolor Rendered Animation. In Proc. NPAR. Eurographics Association, Goslar, Germany, 51--58. http://dx.doi.org/10.2312/exp.20161063

91 Santiago E. Montesdeoca, Hock-Soon Seah, Hans-Martin Rall, and Davide Benvenuti. 2017. Art-directed Watercolor Stylization of 3D Animations in Real-time. Computers & Graphics (2017). To appear. http://dx.doi.org/10.1016/j.cag.2017.03.002

92 Emil Praun , Hugues Hoppe , Matthew Webb , Adam Finkelstein, Real-time hatching, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.581, August 2001 https://dl.acm.org/citation.cfm?id=383328&CFID=558819604&CFTOKEN=68186175 http://doi.acm.org/10.1145/383259.383328

93 Michael P. Salisbury , Sean E. Anderson , Ronen Barzel , David H. Salesin, Interactive pen-and-ink illustration, Proceedings of the 21st annual conference on Computer graphics and interactive techniques, p.101-108, July 1994 https://dl.acm.org/citation.cfm?id=192185&CFID=558819604&CFTOKEN=68186175 http://doi.acm.org/10.1145/192161.192185

94 Amir Semmo , Tobias Dürschmid , Matthias Trapp , Mandy Klingbeil , Jürgen Döllner , Sebastian Pasewaldt, Interactive image filtering with multiple levels-of-control on mobile devices, SIGGRAPH ASIA 2016 Mobile Graphics and Interactive Applications, December 05-08, 2016, Macau https://dl.acm.org/citation.cfm?id=2999521&CFID=558819604&CFTOKEN=68186175 http://doi.acm.org/10.1145/2999508.2999521

95 Amir Semmo , Daniel Limberger , Jan Eric Kyprianidis , Jürgen Döllner, Image stylization by interactive oil paint filtering, Computers and Graphics, v.55 n.C, p.157-171, April 2016 https://dl.acm.org/citation.cfm?id=2905878&CFID=558819604&CFTOKEN=68186175 http://dx.doi.org/10.1016/j.cag.2015.12.001

96 Karen Simonyan and Andrew Zisserman. 2015. Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv.org report 1409.1556. https://arxiv.org/abs/1409.1556

97 Peter-Pike Sloan, William Martin, Amy Gooch, and Bruce Gooch. 2001. The Lit Sphere: A Model for Capturing NPR Shading from Art. In Proc. Graphics Interface. Morgan Kaufmann, San Francisco, 143--150. http://dx.doi.org/10.20380/GI2001.17

98 Minjung Son, Yunjin Lee, Henry Kang, and Seungyong Lee. 2011. Structure Grid for Directional Stippling. Graphical Models 73, 3 (May 2011), 74--87. http://dx.doi.org/10.1016/j.gmod.2010.12.001

99 Bin Wang , Wenping Wang , Huaiping Yang , Jiaguang Sun, Efficient Example-Based Painting and Synthesis of 2D Directional Texture, IEEE Transactions on Visualization and Computer Graphics, v.10 n.3, p.266-277, May 2004 https://dl.acm.org/citation.cfm?id=977350&CFID=558819604&CFTOKEN=68186175 http://dx.doi.org/10.1109/TVCG.2004.1272726

100 Miaoyi Wang, Bin Wang, Yun Fei, Kanglai Qian, Wenping Wang, Jiating Chen, and Jun-Hai Yong. 2014. Towards Photo Watercolorization with Artistic Verisimilitude. IEEE Transactions on Visualization and Computer Graphics 20, 10 (Feb. 2014), 1451--1460. http://dx.doi.org/10.1109/TVCG.2014.2303984

101 Holger WinnemöLler , Jan Eric Kyprianidis , Sven C. Olsen, Special Section on CANS: XDoG: An eXtended difference-of-Gaussians compendium including advanced image stylization, Computers and Graphics, v.36 n.6, p.740-753, October, 2012 https://dl.acm.org/citation.cfm?id=2350456&CFID=558819604&CFTOKEN=68186175 http://dx.doi.org/10.1016/j.cag.2012.03.004

102 Holger Winnemöller , Sven C. Olsen , Bruce Gooch, Real-time video abstraction, ACM Transactions on Graphics (TOG), v.25 n.3, July 2006 https://dl.acm.org/citation.cfm?id=1142018&CFID=558819604&CFTOKEN=68186175 http://doi.acm.org/10.1145/1141911.1142018

103 Chung-Ren Yen , Ming-Te Chi , Tong-Yee Lee , Wen-Chieh Lin, Stylized Rendering Using Samples of a Painted Image, IEEE Transactions on Visualization and Computer Graphics, v.14 n.2, p.468-480, March 2008 https://dl.acm.org/citation.cfm?id=1340175&CFID=558819604&CFTOKEN=68186175 http://dx.doi.org/10.1109/TVCG.2007.70440

104 Kun Zeng, Mingtian Zhao, Caiming Xiong, and Song-Chun Zhu. 2009. From Image Parsing to Painterly Rendering. ACM Transactions on Graphics 29, 1, Article 2 (Dec. 2009), 11 pages. http://doi.acm.org/10.1145/1640443.1640445

Links

Full Text

https://dl.acm.org/authorize?N32488

internal file


Sonstige Links

Abgerufen von „http://de.evo-art.org/index.php?title=Neural_style_transfer:_a_paradigm_shift_for_image-based_artistic_rendering%3F&oldid=33301“