Stylized Keyframe Animation of Fluid Simulations

Aus de_evolutionary_art_org
Wechseln zu: Navigation, Suche

Reference

Mark Browning, Adam Finkelstein and Connelly Barnes: Stylized Keyframe Animation of Fluid Simulations. In: Computational Aesthetics 2014.

DOI

http://dx.doi.org/10.1145/2630397.2630406

Abstract

We present a method that combines hand-drawn artwork with fluid simulations to produce animated fluids in the visual style of the artwork. Given a fluid simulation and a set of keyframes rendered by the artist in any medium, our system produces a set of in-betweens that visually matches the style of the keyframes and roughly follows the motion from the underlying simulation. Our method leverages recent advances in patch-based regenerative morphing and image melding to produce temporally coherent sequences with visual fidelity to the target medium. Because direct application of these methods results in motion that is generally not fluid-like, we adapt them to produce motion closely matching that of the underlying simulation. The resulting animation is visually and temporally coherent, stylistically consistent with the given keyframes, and approximately matches the motion from the simulation. We demonstrate the method with animations in a variety of visual styles.

Extended Abstract

Bibtex

@inproceedings{Browning:2014:SKA:2630397.2630406,
author = {Browning, Mark and Barnes, Connelly and Ritter, Samantha and Finkelstein, Adam},
title = {Stylized Keyframe Animation of Fluid Simulations},
booktitle = {Proceedings of the Workshop on Non-Photorealistic Animation and Rendering},
series = {NPAR '14},
year = {2014},
isbn = {978-1-4503-3020-6},
location = {Vancouver, British Columbia, Canada},
pages = {63--70},
numpages = {8},
url = {http://doi.acm.org/10.1145/2630397.2630406 http://de.evo-art.org/index.php?title=Stylized_Keyframe_Animation_of_Fluid_Simulations },
doi = {10.1145/2630397.2630406},
acmid = {2630406},
publisher = {ACM},
address = {New York, NY, USA},
keywords = {animation, fluids, non-photorealistic rendering},
} 

Used References

Aseem Agarwala , Aaron Hertzmann , David H. Salesin , Steven M. Seitz, Keyframe-based tracking for rotoscoping and animation, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004 http://doi.acm.org/10.1145/1015706.1015764

Alfred Barnat , Zeyang Li , James McCann , Nancy S. Pollard, Mid-level smoke control for 2D animation, Proceedings of Graphics Interface 2011, May 25-27, 2011, St. John's, Newfoundland, Canada http://dl.acm.org/citation.cfm?id=1992922&CFID=588525319&CFTOKEN=29804931

Connelly Barnes , Eli Shechtman , Dan B. Goldman , Adam Finkelstein, The generalized patchmatch correspondence algorithm, Proceedings of the 11th European conference on computer vision conference on Computer vision: Part III, September 05-11, 2010, Heraklion, Crete, Greece http://dl.acm.org/citation.cfm?id=1927010&CFID=588525319&CFTOKEN=29804931

Thaddeus Beier , Shawn Neely, Feature-based image metamorphosis, Proceedings of the 19th annual conference on Computer graphics and interactive techniques, p.35-42, July 1992 http://doi.acm.org/10.1145/133994.134003

Pierre Bénard , Forrester Cole , Michael Kass , Igor Mordatch , James Hegarty , Martin Sebastian Senn , Kurt Fleischer , Davide Pesare , Katherine Breeden, Stylizing animation by example, ACM Transactions on Graphics (TOG), v.32 n.4, July 2013 http://doi.acm.org/10.1145/2461912.2461929

Adrien Bousseau , Fabrice Neyret , Joëlle Thollot , David Salesin, Video watercolorization using bidirectional texture advection, ACM Transactions on Graphics (TOG), v.26 n.3, July 2007 http://doi.acm.org/10.1145/1276377.1276507

John P. Collomosse , David Rowntree , Peter M. Hall, Stroke Surfaces: Temporally Coherent Artistic Animations from Video, IEEE Transactions on Visualization and Computer Graphics, v.11 n.5, p.540-549, September 2005 http://dx.doi.org/10.1109/TVCG.2005.85

Dorin Comaniciu , Peter Meer, Mean Shift: A Robust Approach Toward Feature Space Analysis, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.24 n.5, p.603-619, May 2002 http://dx.doi.org/10.1109/34.1000236

Wagner Toledo Corrêa , Robert J. Jensen , Craig E. Thayer , Adam Finkelstein, Texture mapping for cel animation, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.435-446, July 1998 http://doi.acm.org/10.1145/280814.280949

Soheil Darabi , Eli Shechtman , Connelly Barnes , Dan B. Goldman , Pradeep Sen, Image melding: combining inconsistent images using patch-based synthesis, ACM Transactions on Graphics (TOG), v.31 n.4, p.1-10, July 2012 http://doi.acm.org/10.1145/2185520.2185578

Di Fiore, F., Claes, J., and Van Reeth, F. 2004. A framework for user control on stylized animation of gaseous phenomena.

Ashley M. Eden , Adam W. Bargteil , Tolga G. Goktekin , Sarah Beth Eisinger , James F. O'Brien, A method for cartoon-style rendering of liquid animations, Proceedings of Graphics Interface 2007, May 28-30, 2007, Montreal, Canada http://doi.acm.org/10.1145/1268517.1268528

Raanan Fattal , Dani Lischinski, Target-driven smoke animation, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004 http://doi.acm.org/10.1145/1015706.1015743

Gilland, J. 2009. Elemental Magic, Volume I: The Art of Special Effects Animation. Focal Press.

Haitao He , Duanqing Xu, Real-time cartoon animation of smoke: Natural Phenomena and Special Effects, Computer Animation and Virtual Worlds, v.16 n.3-4, p.441-449, July 2005 http://dx.doi.org/10.1002/cav.v16:3/4

Aaron Hertzmann , Charles E. Jacobs , Nuria Oliver , Brian Curless , David H. Salesin, Image analogies, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.327-340, August 2001 http://doi.acm.org/10.1145/383259.383295

Eakta Jain , Yaser Sheikh , Moshe Mahler , Jessica Hodgins, Three-dimensional proxies for hand-drawn characters, ACM Transactions on Graphics (TOG), v.31 n.1, p.1-16, January 2012 http://doi.acm.org/10.1145/2077341.2077349

V. Kwatra , D. Adalsteinsson , T. Kim , N. Kwatra , M. Carlson , M. C. Lin, Texturing Fluids, IEEE Transactions on Visualization and Computer Graphics, v.13 n.5, p.939-952, September 2007 http://dx.doi.org/10.1109/TVCG.2007.1044

Matt Lockyer , Lyn Bartram, The aMotion toolkit: painting with affective motion textures, Proceedings of the Eighth Annual Symposium on Computational Aesthetics in Graphics, Visualization, and Imaging, June 04-06, 2012, Annecy, France http://dl.acm.org/citation.cfm?id=2328895&CFID=588525319&CFTOKEN=29804931

Chongyang Ma , Li-Yi Wei , Baining Guo , Kun Zhou, Motion field texture synthesis, ACM Transactions on Graphics (TOG), v.28 n.5, December 2009 http://doi.acm.org/10.1145/1618452.1618456

Dhruv Mahajan , Fu-Chung Huang , Wojciech Matusik , Ravi Ramamoorthi , Peter Belhumeur, Moving gradients: a path-based method for plausible image interpolation, ACM Transactions on Graphics (TOG), v.28 n.3, August 2009 http://doi.acm.org/10.1145/1531326.1531348

Morgan McGuire , Andi Fein, Real-time rendering of cartoon smoke and clouds, Proceedings of the 4th international symposium on Non-photorealistic animation and rendering, June 05-07, 2006, Annecy, France http://doi.acm.org/10.1145/1124728.1124733

Lena Petrović , Brian Fujito , Lance Williams , Adam Finkelstein, Shadows for cel animation, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.511-516, July 2000 http://doi.acm.org/10.1145/344779.345073

Andrew Selle , Alex Mohr , Stephen Chenney, Cartoon rendering of smoke animations, Proceedings of the 3rd international symposium on Non-photorealistic animation and rendering, June 07-09, 2004, Annecy, France http://doi.acm.org/10.1145/987657.987666

Shechtman, E., Rav-Acha, A., Irani, M., and Seitz, S. 2010. Regenerative morphing. In IEEE Conference on Computer VIsion and Pattern Recognition (CVPR).

Simakov, D., Caspi, Y., Shechtman, E., and Irani, M. 2008. Summarizing visual data using bidirectional similarity. In 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2008), 24--26 June 2008, Anchorage, Alaska, USA, IEEE Computer Society.

Solomon, C. 1994. Enchanted Drawings: The History of Animation. Random House.

Jos Stam, Stable fluids, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.121-128, July 1999 http://doi.acm.org/10.1145/311535.311548

Thomas, F., and Johnston, O. 1987. Disney Animation: The Illusion of Life. Abbeville Press.

Adrien Treuille , Antoine McNamara , Zoran Popović , Jos Stam, Keyframe control of smoke simulations, ACM Transactions on Graphics (TOG), v.22 n.3, July 2003 http://doi.acm.org/10.1145/882262.882337

Yonatan Wexler , Eli Shechtman , Michal Irani, Space-Time Completion of Video, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.29 n.3, p.463-476, March 2007 http://dx.doi.org/10.1109/TPAMI.2007.60

Wolberg, G. 1998. Image morphing: a survey. The visual computer 14, 8, 360--372.

Mi You , Jinho Park , Byungkuk Choi , Junyong Noh, Cartoon Animation Style Rendering of Water, Proceedings of the 5th International Symposium on Advances in Visual Computing: Part I, November 30-December 02, 2009, Las Vegas, Nevada http://dx.doi.org/10.1007/978-3-642-10331-5_7

Jinhui Yu , Xinan Jiang , Haiying Chen , Cheng Yao, Real-time cartoon water animation, Computer Animation and Virtual Worlds, v.18 n.4-5, p.405-414, September 2007 http://dx.doi.org/10.1002/cav.v18:4/5

Bo Zhu , Michiaki Iwata , Ryo Haraguchi , Takashi Ashihara , Nobuyuki Umetani , Takeo Igarashi , Kazuo Nakazawa, Sketch-based Dynamic Illustration of Fluid Systems, ACM Transactions on Graphics (TOG), v.30 n.6, December 2011 http://doi.acm.org/10.1145/2070781.2024168


Links

Full Text

http://gfx.cs.princeton.edu/gfx/pubs/Browning_2014_SKA/nprfluid.pdf

intern file

Sonstige Links

http://gfx.cs.princeton.edu/gfx/pubs/Browning_2014_SKA/index.php