Image Stylization by Oil Paint Filtering using Color Palettes

Aus de_evolutionary_art_org
Wechseln zu: Navigation, Suche

Reference

Amir Semmo, Daniel Limberger, Jan Eric Kyprianidis, and Jürgen Döllner: Image Stylization by Oil Paint Filtering using Color Palettes. In: Computational Aesthetics 2015 CAE'15, 149-158.

DOI

http://dx.doi.org/10.2312/exp.20151188

Abstract

This paper presents an approach for transforming images into an oil paint look. To this end, a color quantization scheme is proposed that performs feature-aware recolorization using the dominant colors of the input image. In addition, an approach for real-time computation of paint textures is presented that builds on the smoothed structure adapted to the main feature contours of the quantized image. Our stylization technique leads to homogeneous outputs in the color domain and enables creative control over the visual output, such as color adjustments and per-pixel parametrizations by means of interactive painting.

Extended Abstract

Bibtex

@inproceedings{Semmo:2015:ISO:2811239.2811248,
author = {Semmo, Amir and Limberger, Daniel and Kyprianidis, Jan Eric and D\"{o}llner, J\"{u}rgen},
title = {Image Stylization by Oil Paint Filtering Using Color Palettes},
booktitle = {Proceedings of the Workshop on Computational Aesthetics},
series = {CAE '15},
year = {2015},
location = {Istanbul, Turkey},
pages = {149--158},
numpages = {10},
url = {http://dl.acm.org/citation.cfm?id=2811239.2811248 http://de.evo-art.org/index.php?title=Image_Stylization_by_Oil_Paint_Filtering_using_Color_Palettes },
acmid = {2811248},
publisher = {Eurographics Association},
address = {Aire-la-Ville, Switzerland, Switzerland},
}

Used References

1 Ken-ichi Anjyo , Shuhei Wemler , William Baxter, Tweakable light and shade for cartoon animation, Proceedings of the 4th international symposium on Non-photorealistic animation and rendering, June 05-07, 2006, Annecy, France http://dl.acm.org/citation.cfm?id=1124750&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1145/1124728.1124750

2 {BBL * 06} Brox T., Boomgaard R., Lauze F., Weijer J., Weickert J., Mrázek P., Kornprobst P.: Adaptive Structure Tensors and their Applications. Visualization and Processing of Tensor Fields (2006), 17--47.

3 Adrien Bousseau , Matt Kaplan , Joëlle Thollot , François X. Sillion, Interactive watercolor rendering with temporal coherence and abstraction, Proceedings of the 4th international symposium on Non-photorealistic animation and rendering, June 05-07, 2006, Annecy, France http://dl.acm.org/citation.cfm?id=1124751&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1145/1124728.1124751

4 William Baxter , Jeremy Wendt , Ming C. Lin, IMPaSTo: a realistic, interactive model for paint, Proceedings of the 3rd international symposium on Non-photorealistic animation and rendering, June 07-09, 2004, Annecy, France http://dl.acm.org/citation.cfm?id=987665&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1145/987657.987665

5 Nelson Chu , William Baxter , Li-Yi Wei , Naga Govindaraju, Detail-preserving paint modeling for 3D brushes, Proceedings of the 8th International Symposium on Non-Photorealistic Animation and Rendering, June 07-10, 2010, Annecy, France http://dl.acm.org/citation.cfm?id=1809943&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1145/1809939.1809943

6 Brian Cabral , Leith Casey Leedom, Imaging vector fields using line integral convolution, Proceedings of the 20th annual conference on Computer graphics and interactive techniques, p.263-270, August 02-06, 1993, Anaheim, CA http://dl.acm.org/citation.cfm?id=166151&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1145/166117.166151

7 Junqing Chen , T. N. Pappas , A. Mojsilovic , B. E. Rogowitz, Adaptive perceptual color-texture image segmentation, IEEE Transactions on Image Processing, v.14 n.10, p.1524-1536, October 2005 http://dl.acm.org/citation.cfm?id=2320769&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1109/TIP.2005.852204

8 Doug DeCarlo , Anthony Santella, Stylization and abstraction of photographs, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002 http://dl.acm.org/citation.cfm?id=566650&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1145/566654.566650

9 Zeev Farbman , Raanan Fattal , Dani Lischinski , Richard Szeliski, Edge-preserving decompositions for multi-scale tone and detail manipulation, ACM Transactions on Graphics (TOG), v.27 n.3, August 2008 http://dl.acm.org/citation.cfm?id=1360666&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1145/1360612.1360666

10 Bruce Gooch , Greg Coombe , Peter Shirley, Artistic Vision: painterly rendering using computer vision techniques, Proceedings of the 2nd international symposium on Non-photorealistic animation and rendering, June 03-05, 2002, Annecy, France http://dl.acm.org/citation.cfm?id=508545&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1145/508530.508545

11 {GP88} Gervautz M., Purgathofer W.: A Simple Method for Color Quantization: Octree Quantization. In New Trends in Computer Graphics. Springer Berlin Heidelberg, 1988, pp. 219--231.

12 Paul Haeberli, Paint by numbers: abstract image representations, ACM SIGGRAPH Computer Graphics, v.24 n.4, p.207-214, Aug. 1990 http://dl.acm.org/citation.cfm?id=97902&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1145/97880.97902

13 James Hays , Irfan Essa, Image and video based painterly animation, Proceedings of the 3rd international symposium on Non-photorealistic animation and rendering, June 07-09, 2004, Annecy, France http://dl.acm.org/citation.cfm?id=987676&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1145/987657.987676

14 Paul Heckbert, Color image quantization for frame buffer display, ACM SIGGRAPH Computer Graphics, v.16 n.3, p.297-307, July 1982 http://dl.acm.org/citation.cfm?id=801294&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1145/965145.801294

15 Aaron Hertzmann, Painterly rendering with curved brush strokes of multiple sizes, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.453-460, July 1998 http://dl.acm.org/citation.cfm?id=280951&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1145/280814.280951

16 Aaron Hertzmann, Fast paint texture, Proceedings of the 2nd international symposium on Non-photorealistic animation and rendering, June 03-05, 2002, Annecy, France http://dl.acm.org/citation.cfm?id=508546&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1145/508530.508546

17 {HGT13} Hegde S., Gatzidis C., Tian F.: Painterly rendering techniques: a state-of-the-art review of current approaches. Comp. Anim. Virtual Worlds 24, 1 (2013), 43--64.

18 Pat Hanrahan , Paul Haeberli, Direct WYSIWYG painting and texturing on 3D shapes. ACM SIGGRAPH Computer Graphics, v.24 n.4, p.215-223, Aug. 1990 [doi>10.1145/97880.97903] An error occurred during the printing of this article that reversed the print order of pages 118 and 119. While we have corrected the sort order of the 2 pages in the DL, the PDF did not allow us to repaginate the 2 pages. http://dl.acm.org/citation.cfm?id=97903&CFID=724111209&CFTOKEN=48939661

19 Jan Eric Kyprianidis , John Collomosse , Tinghuai Wang , Tobias Isenberg, State of the "Art”: A Taxonomy of Artistic Stylization Techniques for Images and Video, IEEE Transactions on Visualization and Computer Graphics, v.19 n.5, p.866-885, May 2013 http://dl.acm.org/citation.cfm?id=2479163&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1109/TVCG.2012.160

20 {KD08} Kyprianidis J. E., Döllner J.: Image Abstraction by Structure Adaptive Filtering. In Proc. EG UK TPCG (2008), pp. 51--58.

21 {KK11} Kyprianidis J. E., Kang H.: Image and Video Abstraction by Coherence-Enhancing Filtering. Comput. Graph. Forum 30, 2 (2011), 593--602.

22 Henry Kang , Seungyong Lee , Charles K. Chui, Flow-Based Image Abstraction, IEEE Transactions on Visualization and Computer Graphics, v.15 n.1, p.62-76, January 2009 http://dl.acm.org/citation.cfm?id=1477372&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1109/TVCG.2008.81

23 Tapas Kanungo , David M. Mount , Nathan S. Netanyahu , Christine D. Piatko , Ruth Silverman , Angela Y. Wu, An Efficient k-Means Clustering Algorithm: Analysis and Implementation, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.24 n.7, p.881-892, July 2002 http://dl.acm.org/citation.cfm?id=628801&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1109/TPAMI.2002.1017616

24 Jingwan Lu , Connelly Barnes , Stephen DiVerdi , Adam Finkelstein, RealBrush: painting with examples of physical media, ACM Transactions on Graphics (TOG), v.32 n.4, July 2013 http://dl.acm.org/citation.cfm?id=2461998&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1145/2461912.2461998

25 Anat Levin , Dani Lischinski , Yair Weiss, Colorization using optimization, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004 http://dl.acm.org/citation.cfm?id=1015780&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1145/1015706.1015780

26 Jingwan Lu , Pedro V. Sander , Adam Finkelstein, Interactive painterly stylization of images, videos and 3D animations, Proceedings of the 2010 ACM SIGGRAPH symposium on Interactive 3D Graphics and Games, February 19-21, 2010, Washington, D.C. http://dl.acm.org/citation.cfm?id=1730825&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1145/1730804.1730825

27 {MEO94} Mahy M., Eycken L., Oosterlinck A.: Evaluation of Uniform Color Spaces Developed after the Adoption of CIELAB and CIELUV. Color Research & Application 19, 2 (1994), 105--121.

28 David Mould, A stained glass image filter, Proceedings of the 14th Eurographics workshop on Rendering, June 25-27, 2003, Leuven, Belgium http://dl.acm.org/citation.cfm?id=882407&CFID=724111209&CFTOKEN=48939661

29 Peter O'Donovan , David Mould, Felt-based rendering, Proceedings of the 4th international symposium on Non-photorealistic animation and rendering, June 05-07, 2006, Annecy, France http://dl.acm.org/citation.cfm?id=1124738&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1145/1124728.1124738

30 Sven C. Olsen , Bruce A. Maxwell , Bruce Gooch, Interactive vector fields for painterly rendering, Proceedings of Graphics Interface 2005, May 09-11, 2005, Victoria, British Columbia http://dl.acm.org/citation.cfm?id=1089548&CFID=724111209&CFTOKEN=48939661

31 Bui Tuong Phong, Illumination for computer generated pictures, Communications of the ACM, v.18 n.6, p.311-317, June 1975 http://dl.acm.org/citation.cfm?id=360839&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1145/360825.360839

32 {Sco05} Scott M.: Oil Painter's Bible. Chartwell Books, 2005.

33 Martin Schwarz , Tobias Isenberg , Katherine Mason , Sheelagh Carpendale, Modeling with rendering primitives: an interactive non-photorealistic canvas, Proceedings of the 5th international symposium on Non-photorealistic animation and rendering, August 04-05, 2007, San Diego, California http://dl.acm.org/citation.cfm?id=1274874&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1145/1274871.1274874

34 Youcef Saad , Martin H Schultz, GMRES: a generalized minimal residual algorithm for solving nonsymmetric linear systems, SIAM Journal on Scientific and Statistical Computing, v.7 n.3, p.856-869, July 1986 http://dl.acm.org/citation.cfm?id=14074&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1137/0907058

35 Kartic Subr , Cyril Soler , Frédo Durand, Edge-preserving multiscale image decomposition based on local extrema, ACM Transactions on Graphics (TOG), v.28 n.5, December 2009 http://dl.acm.org/citation.cfm?id=1618493&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1145/1618452.1618493

36 Hideki Todo , Ken-ichi Anjyo , William Baxter , Takeo Igarashi, Locally controllable stylized shading, ACM Transactions on Graphics (TOG), v.26 n.3, July 2007 http://dl.acm.org/citation.cfm?id=1276399&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1145/1276377.1276399

37 C. Tomasi , R. Manduchi, Bilateral Filtering for Gray and Color Images, Proceedings of the Sixth International Conference on Computer Vision, p.839, January 04-07, 1998 http://dl.acm.org/citation.cfm?id=939190&CFID=724111209&CFTOKEN=48939661

38 {Wei98} Weickert J.: Anisotropic diffusion in image processing, vol. 1. Teubner Stuttgart, 1998.

39 Fang Wen , Qing Luan , Lin Liang , Ying-Qing Xu , Heung-Yeung Shum, Color sketch generation, Proceedings of the 4th international symposium on Non-photorealistic animation and rendering, June 05-07, 2006, Annecy, France http://dl.acm.org/citation.cfm?id=1124737&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1145/1124728.1124737

40 Holger Winnemöller , Sven C. Olsen , Bruce Gooch, Real-time video abstraction, ACM Transactions on Graphics (TOG), v.25 n.3, July 2006 http://dl.acm.org/citation.cfm?id=1142018&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1145/1141911.1142018

41 Li Xu , Cewu Lu , Yi Xu , Jiaya Jia, Image smoothing via L0 gradient minimization, ACM Transactions on Graphics (TOG), v.30 n.6, December 2011 http://dl.acm.org/citation.cfm?id=2024208&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1145/2070781.2024208

42 Jong-Chul Yoon , In-Kwon Lee , Henry Kang, Video Painting Based on a Stabilized Time-Varying Flow Field, IEEE Transactions on Visualization and Computer Graphics, v.18 n.1, p.58-67, January 2012 http://dl.acm.org/citation.cfm?id=2086650&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1109/TVCG.2011.47

43 Jinze Yu , Cewu Lu , Yoichi Sato, Sparsity-based color quantization with preserved image details, SIGGRAPH Asia 2014 Posters, December 03-06, 2014, Shenzhen, China http://dl.acm.org/citation.cfm?id=2668999&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1145/2668975.2668999

44 X. D. Yue , D. Q. Miao , L. B. Cao , Q. Wu , Y. F. Chen, An efficient color quantization based on generic roughness measure, Pattern Recognition, v.47 n.4, p.1777-1789, April, 2014 http://dl.acm.org/citation.cfm?id=2565920&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1016/j.patcog.2013.11.017

45 Mingtian Zhao , Song-Chun Zhu, Sisley the abstract painter, Proceedings of the 8th International Symposium on Non-Photorealistic Animation and Rendering, June 07-10, 2010, Annecy, France http://dl.acm.org/citation.cfm?id=1809951&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1145/1809939.1809951

46 Kun Zeng , Mingtian Zhao , Caiming Xiong , Song-Chun Zhu, From image parsing to painterly rendering, ACM Transactions on Graphics (TOG), v.29 n.1, p.1-11, December 2009 http://dl.acm.org/citation.cfm?id=1640445&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1145/1640443.1640445

Links

Full Text

https://hpi.de/fileadmin/user_upload/fachgebiete/doellner/publications/2015/SLKD2015/asemmo-cae2015-authors-version.pdf

intern file

Sonstige Links

http://dl.acm.org/citation.cfm?id=2811248&CFID=724111209&CFTOKEN=48939661