Genetic Programming for Non-Photorealistic Rendering

Aus de_evolutionary_art_org
Wechseln zu: Navigation, Suche


Reference

Maryam Baniasadi: Genetic Programming for Non-Photorealistic Rendering. Master Thesis & Technical Report # CS-13-08 June 2013, Brock University, Department of Computer Science.

DOI

Abstract

This thesis focuses on developing an evolutionary art system using genetic programming. The main goal is to produce new forms of evolutionary art that filter existing images into new non-photorealistic (NPR) styles, by obtaining images that look like traditional media such as watercolor or pencil, as well as brand new effects. The approach permits GP to generate creative forms of NPR results. The GP language is extended with different techniques and methods inspired from NPR research such as colour mixing expressions, image processing filters and painting algorithm. Colour mixing is a major new contribution, as it enables many familiar and innovative NPR effects to arise. Another major innovation is that many GP functions process the canvas (rendered image), while is dynamically changing. Automatic fitness scoring uses aesthetic evaluation models and statistical analysis, and multi- objective fitness evaluation is used. Results showed a variety of NPR effects, as well as new, creative possibilities.

Extended Abstract

Bibtex

Used References

[1] Surveymonkey. http://www.surveymonkey.com/.

[2] Bousseau. A, Kaplan. M, Thollot. J, and Sillion. X. F. Interactive wa- tercolor rendering with temporal coherence and abstraction. In NPAR ’06 Proceedings 4th International Symposium on Non-Photorealistic An- imation and Rendering, pages 141–149, 2006.

[3] Hertzmann. A. Painterly rendering with curved brush strokes of multiple sizes. In SIGGRAPH ’98 Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques, pages 453–460, New York, 1998. ACM.

[4] Hertzmann. A, Jacobs. C. E, Oliver. N, Curless. B, and Salesin. D. H. Image analogies. In SIGGRAPH ’01 Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, pages 327–340, New York, 2001. ACM.

[5] Izadi. A and Ciesielski. V. Evolved strokes in non photorealistic render- ing. In Ardil. C, editor, Proceedings of the World Academy of Science Engineering and Technology, pages 1–4. Springer, 2010.

[6] Rowbottom. A. Evolutionary art and form. In Bentley. P. J, editor, Evolutionary Design by Computers, San Francisco, CA, 1999. Morgan Kaufman Publishers Inc.

[7] Thompson. A. Evolving fault tolerant systems. Genetic Algorithms in Engineering Systems: Innovations and Applications, IEEE Conference, (414):524–529, 1995.

[8] Thompson. A and Layzell. P. Analysis of unconventional evolved elec- tronics. Communications of the ACM, 42(4):71–79, 1999.

[9] Baxter. B, Scheib. V, Lin. M. C, and Manocha. D. Dab: Interactive haptic painting with 3d virtual brushes. In SIGGRAPH ’01 Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, pages 461–468. ACM Press, 2001.

[10] Cho. S. B. Towards creative evolutionary systems with interactive ge- netic algorithm. Applied Intelligence, 16(2):129–138, 2002.

[11] Gooch. B and Gooch. A. Non-Photorealistic Rendering. A K Peters, 2001.

[12] Spehar. B, Clifford. C. W. G, Newell. B. R, and Taylor. R. P. Universal aesthetic of fractals. Computers and Graphics, 27(5):813820, 2003.

[13] Li. C. Aesthetic visual quality assessment of paintings. IJSTSP: IEEE Journal of Selected Topics in Signal Processing, 3(2):236–253, 2009.

[14] Neufeld. C, Ross. B. J, and Ralph. W, editors. The Evolution of Artistic Filters, Vancouver, 2006. Evolutionary Art Competition.

[15] Yip. C. Evolving image filters. Master’s thesis, Imperial College of Science, Technology and Medicine, 2004. Imperial College of Science, Technology, and Medicine.

[16] Birkhoff. G. D. Aesthetic Measure. Harvard University Press, Cam- bridge, MA, USA, 1933.

[17] Hart. A. D. Toward greater artistic control for interactive evolution of images and animation. Applications of Evolutionary Computing, 4448:527–536, 2007.

[18] Wackerly. D, Mendenhall. W, and Scheaffer. R. L. Mathematical Statis- tics with Applications. Duxbury Advanced Series, sixth edition, 2002.

[19] Heijer. E den and Eiben. A. E. Comparing aesthetic measures for evo- lutionary art. In EvoApplications (2), pages 311–320, 2010.

[20] Goldberg. D. E. Genetic Algorithms in Search, Optimization and Ma- chine Learning. Addison-Wesley Longman Publishing Co., Inc. Boston, MA, USA, 1989.

[21] Jansson. E. Brush painting algorithms. Technical report, datorteknik, 2004.

[22] Winkenbach. G and Salesin. D.H. Computer-generated pen-and-ink il- lustration. In SIGGRAPH ’94 Proceedings of Annual Conference Series on Computer Graphics Proceedings, New Yourk, ACM Press, 1994.

[23] Holland. J. H. Adaptation in Natural and Artificial Systems. University of Michigan Press, 1975.

[24] Huang. H, Fu. T, and Li. C. Anisotropic brush for painterly rendering. In Proceedings of Computer Graphics International. Computer Graphics Society, 2010.

[25] Kang. H, Chakraborty. U, Chui. C, and He. W. Multi-scale stroke-based rendering by evolutionary algorithm. In Proceedings International Work- shop on Frontiers of Evolutionary Algorithms, pages 546–549. JCIS, 2005.

[26] Bentley. P. J. Generic Evolutionary Design of Solid Objects Using a Genetic Algorithm. PhD thesis, Division of Computing and Control Systems, Department of Engineering, University of Huddersfield, 1996.

[27] Bentley. P. J. Aspects of evolutionary design by computers. In Pro- ceedings of the 3rd On-line World Conference on Soft Computing in Engineering Design and Manufacturing, 1998.

[28] Bentley. Peter J. and Wakefield. Jonathan P. Finding acceptable so- lutions in the pareto-optimal range using multiobjective genetic algo- rithms. In Soft Computing in Engineering Design and Manufacturing, pages 231–240. Springer-Verlag, 1998.

[29] Branke. J, Deb. K, Miettinen. K, and Slowiski. R. (Eds.). Multiobjective Optimization: Interactive and Evolutionary Approaches. Spriger, 2008.

[30] Collomosse. J and Kyprianidi. J. E. Artistic Stylization of Images and Video. Tutorial at Eurographics.Retrieved from http://kahlan.eps.surrey.ac.uk/EG2011/, 2011.

[31] Collomosse. J and Hall. P. Genetic paint: A search for salient paintings. In Applications on Evolutionary Computing, pages 437–447, 2005.

[32] Curtis. C. J, Anderson. S. E, Seims. J. E, Fleischer. K. W, and Salesin. D. H. Computer-generated watercolor. In SIGGRAPH ’97 Proceedings of Annual Cofnerence Series on Computer Graphics Proceedings, Addision- Wesley, 1997.

[33] Fogel. L. J, Owens. A. J, and Walsh. M. J. Artificial intelligence through simulated evolution. Wiley, 1966.

[34] Graf. J and Banzhaf. W. Interactive evolution of images. Proceedings International Conference on Evolutionary Programming, pages 53–65, 1995.

[35] Graham. D. J and Redies. C. Statistical regularities in art: Relations with visual coding and perception. Vision Research, 50(16):1503–1509, 2010.

[36] Hays. J and Essa. I. Image and video based painterly animation. In NPAR ’04 3rd International Symposium on Non-Photorealistic Anima- tion and Rendering, pages 113–120. ACM New York, NY, USA, 2004.

[37] Huxtable. J. JH LABS. Java Image Processing. Retrieved from http://www.jhlabs.com, 2004. Last accessed April 16, 2013.

[38] Ralph. W. J. Painting the bell curve: The occurrence of the normal distribution in fine art. Unpublished, 2006.

[39] Rigau. J, Feixas. M, and Sbert. M. Conceptualizing birkhoff’s aesthetic measure using shannon entropy and kolmogorov complexity. In Compu- tational Aesthetics, pages 105–112, 2007.

[40] Ross. B. J and Zhu. H. Procedural texture evolution using multi- objective optimization. New Generation Computing, 22(3):271–293, 2004.

[41] Ross. B. J, Ralph. W, and Zong. H. Evolutionary image synthesis using a model of aesthetics. In IEEE Congress on Evolutionary Computation, pages 1087–1094. CEC, 2006.

[42] Deb. K. Multi-Objective Optimization Using Evolutionary Algorithms. Wiley, 2009.

[43] Sims. K. Artificial evolution for computer graphics. ACM Computer Graphics, 25(4):319–328, 1991.

[44] Sims. K. evolution of equations for procedural models. The Visual Computer 9, 9:466476, 1993.

[45] Wiens. A. L and Ross. B. J. Gentropy: evolving 2d textures. Computers and Graphics Journal, 26(1):75–88, 2006.

[46] Cover T. M and Thomas J. A. Elements of Information theory. Wiley Series in Telecommunications, 1991.

[47] Hughes. J. M, Graham. D. J, and Rockmore. D. N. Quantifica- tion of artistic style through sparse coding analysis in the drawings of pieter bruegel the elder. Proceedings Natunal Academic Science, 107(4):12791283, 2010.

[48] Lewis. M. Aesthetic evolutionary design with data flow networks. Pro- ceedings Generative Art 2000, 2000.

[49] Miyahara. M and Yoshida. Y. Mathematical transform of (r,g,b) color data to munsell (h,v,c) color data. In SPIE Proceedings Visual Commu- nication and Image Processing, volume 1001, page 650657, 1988.

[50] Shiraishi. M and Yamaguchi. Y. An algorithm for automatic painterly rendering based on local source image approximation. In NPAR ’00 Proceedings of the 1st International Symposium on Non-photorealistic Animation and Rendering, pages 53–58. ACM, New York, 2000.

[51] David J. Montana. Strongly typed genetic programming. Evolutionary Computation, 3:199–230, 1994.

[52] Siu-Hang C. N, Baxter. W, Wei. Li-Yi, and Govindaraju. N. K. Detail-preserving paint modeling for 3d brushes. In NPAR ’10: Non- Photorealistic Animation and Rendering, pages 27–34, 2010.

[53] Xie. N, Laga. H, Saito. S, and Nakajima. M. Ir2s: interactive real photo to sumi-e. In NPAR ’10: Non-Photorealistic Animation and Rendering, pages 63–71, 2010.

[54] NIH. ImageJ. Image Processing and Analysis in Java. Retrieved from http://rsb.info.nih.gov, 2004. Last accessed April 16, 2013.

[55] Barile. P, Ciesielski. V, and Trist. K. Non-photorealistic rendering using genetic programming. In SEAL ’08 Proceedings of the 7th International Conference on Simulated Evolution And Learning, pages 299–308, Mel- bourne, 2008. Springer.

[56] Collomosse. J. P. Evolutionary search for the artistic rendering of pho- tographs. In The Art of Artificial Evolution, pages 39–62, 2008.

[57] Haeberli. P. Paint by numbers: Abstract image representation. Com- puter Graphics, 24(4):207–214, 1990.

[58] Machado. P and Cardoso. A. Computing aesthetics. In de Oliveira. F.M., editor, SBIA 1998. LNCS (LNAI), pages 219–228, Heidelberg, 1998. Springer.

[59] Machado. P, Dias. A, Duarte. N, and A Cardoso, editors. Giving Colour to Images. Proceedings AISB 2002 Symposium on AI and Creativity in the Arts, 2002.

[60] Walsh. P and Gade. P. The use of an aesthetic measure for the evolution of fractal landscapes. In IEEE Congress on Evolutionary Computation, pages 1613–1619, 2011.

[61] Kolas. Q. Image processing with gluas. Retrieved from http://codecave.org/image-processing, 2005. Last accessed April 16, 2013.

[62] Xu. Q, D’Souza. D. J, and Ciesielski. V. Evolving images for entertain- ment. In IE, page 26, 2007.

[63] Bergen. S. R. automatic structure generation using genetic programming and fractal geometry. Master’s thesis, Department of Computer Science, Brock Univeristy, 2011.

[64] Dawkins. R. The Blind Watchmark. Penguin Books Ltd, 1986.

[65] Gonzalez. R and Woods. R. Digital Image Processing. Prentice Hall, 2 edn edition, 2000.

[66] Koza. J. R. Genetic Programming: On the programming of computers by means of natural selection. MIT Press, 1992.

[67] Poli. R, Langdon. W. R, and McPhee. N. F. A Field Guide to Genetic Programming. http://lulu.com and freely available at http://www.gp-field-guide.org.uk, 2008. With contributions by Koza. J. R.

[68] Smith. J. R and Chang. S. F. Visual seek: a fully automated content- based image query system. In MULTIMEDIA ’96 Proceedings of the 4th ACM International Conference on Multimedia, pages 87–98, New York, 1996. ACM.

[69] Colton. S, Valstar. M. F, and Pantic. M. Emotionally aware automated portrait painting. In Proceedings of the 3rd International Conference on Digital Interactive Media in Entertainment and Arts, pages 304–311, 2008.

[70] Colton. S and Torres. P. Evolving approximate image filters. In Pro- ceedings of the EvoWorkshops, pages 467–477. LNCS, 2009.

[71] Fan. S, Wang. R, Zhang. Y, and Guo. K. Classifying computer generated graphics and natural images based on image contour information. Jour- nal of Information and Computational Science, 9(10):28772895, 2012.

[72] Khan. S. S and Vogel. D. Evaluating visual aesthetics in photographic portraiture. In EXPRESSIVE: 8th International Symposium on Com- putational Aesthetics in Graphics, Visualization, and Imaging (CAe), Annecy, 2012.

[73] Luke S. Ecj - a java-based evolutionary computation research system. Retrieved from http://cs.gmu.edu/ eclab/projects/ecj/. Last accessed April 16, 2013.

[74] Rooke S. The genetic-evolutionary art process of Steven Rooke. Re- trieved from http://srooke.com/process.html, 1993. Last accessed April 16, 2013.

[75] Todd. S and Latham. W. Evolutionary Art and Computers. Academic Press, 1992.

[76] Yamamoto. S, Mao. X, and Imamiya. A. Colored pencil filter with custom colors. In PG ’04 Proceedings of 12th Pacific Conference on Computer Graphics and Applications, pages 329–338. IEEE Computer Society Washington, DC, USA, 2004.BIBLIOGRAPHY 138

[77] Strothotte. T and Schlechtweg. S. Non-Photorealistic Computer Graphic modeling rendering and animation. Morgan Kaufmann, 2002. [78] Van Laerhoven. T and Van Reeth. F. Brush up your painting skills: Realistic brush design for interactive painting applications. The Visual Computer: International Journal of Computer Graphics, 23(9):763–771, 2007.

[79] Niblack. W, Barber. R, Equitz. W, Flickner. M. D, Glasman. E. H, Petkovic. D, Yanker. P, Faloutsos. C, and Taubin. G. Qbic project: querying images by content, using color, texture, and shape. In Storage and Retrieval for Image and Video Databases, volume 1908, pages 173– 187, 1993.

[80] Van Haever. W, Van Laerhoven. T, Di Fiore. F, and Van Reeth. F. From dust till drawn: A real-time bidirectional pastel simulation. The Visual Computer, 23(9-11):925–934, 2007.

Links

Full Text

http://www.cosc.brocku.ca/files/downloads/research/cs1308.pdf

intern file

Sonstige Links

Abgerufen von „http://de.evo-art.org/index.php?title=Genetic_Programming_for_Non-Photorealistic_Rendering&oldid=1345“