Painterly rendering for video and interaction
Inhaltsverzeichnis
Reference
Hertzmann, A., Perlin, K. (2000). Painterly rendering for video and interaction. In: Proc. ACM NPAR, 7–12.
DOI
http://dx.doi.org/10.1145/340916.340917
Abstract
We present new methods for painterly video processing. Based on our earlier still image processing technique, we “paint over” successive frames of animation, applying paint only in regions where the source video is changing. Image regions with minimal changes, such as due to video noise, are also left alone, using a simple difference masking tech- nique. Optionally, brush strokes may be warped between frames using computed or procedural optical flow. These methods produce video with a novel visual style distinct from previously demonstrated algorithms. Without optical flow, the video gives the effect of a painting that has been repeatedly updated and photographed, similar to paint- on-glass animation. We feel that this gives a subjective im- pression of the work of a human hand. With optical flow, the painting surface flows and deforms to follow the shape of the world.
We have constructed an interactive painting exhibit, in which a painting is continually updated. Viewers have found this to be a compelling experience, suggesting the promise of non-photorealistic rendering for creating compelling in- teractive visual experiences.
Extended Abstract
Bibtex
Used References
Franklin C. Crow, Summed-area tables for texture mapping, Proceedings of the 11th annual conference on Computer graphics and interactive techniques, p.207-212, January 1984 http://doi.acm.org/10.1145/800031.808600
Cassidy J. Curtis, Loose and sketchy animation, ACM SIGGRAPH 98 Electronic art and animation catalog, p.145, July 19-24, 1998, Orlando, Florida, USA http://doi.acm.org/10.1145/281388.281913
Cassidy Curtis, Amy Gooch, Bruce Gooch, Stuart Green, Aaron Hertzmann, Peter Litwinowicz, David Salesin, and Simon Schofield. Non-Photorealistic Rendering. SIGGRAPH 99 Course Notes, 1999.
Eric Daniels, Deep canvas in Disney's Tarzan, ACM SIGGRAPH 99 Conference abstracts and applications, p.200, August 08-13, 1999, Los Angeles, California, USA http://doi.acm.org/10.1145/311625.312010
Bruce Gooch , Peter-Pike J. Sloan , Amy Gooch , Peter Shirley , Richard Riesenfeld, Interactive technical illustration, Proceedings of the 1999 symposium on Interactive 3D graphics, p.31-38, April 26-29, 1999, Atlanta, Georgia, USA http://doi.acm.org/10.1145/300523.300526
Paul Haeberli, Paint by numbers: abstract image representations, ACM SIGGRAPH Computer Graphics, v.24 n.4, p.207-214, Aug. 1990 http://doi.acm.org/10.1145/97880.97902
Aaron Hertzmann, Painterly rendering with curved brush strokes of multiple sizes, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.453-460, July 1998 http://doi.acm.org/10.1145/280814.280951
Takeo Igarashi , Satoshi Matsuoka , Hidehiko Tanaka, Teddy: a sketching interface for 3D freeform design, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.409-416, July 1999 http://doi.acm.org/10.1145/311535.311602
Michael A. Kowalski , Lee Markosian , J. D. Northrup , Lubomir Bourdev , Ronen Barzel , Loring S. Holden , John F. Hughes, Art-based rendering of fur, grass, and trees, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.433-438, July 1999 http://doi.acm.org/10.1145/311535.311607
Peter Litwinowicz, Impressions of San Francisco, ACM SIGGRAPH 97 Visual Proceedings: The art and interdisciplinary programs of SIGGRAPH '97, p.268, August 03-08, 1997, Los Angeles, California, USA http://doi.acm.org/10.1145/259081.259396
Peter Litwinowicz, Processing images and video for an impressionist effect, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.407-414, August 1997 http://doi.acm.org/10.1145/258734.258893
Peter Litwinowicz. Image-Based Rendering and Non- Photorealistic Rendering. In Stuart Green, editor, Non- Photorealistic Rendering, SIGGRAPH Course Notes. 1999.
Lee Markosian , Michael A. Kowalski , Daniel Goldstein , Samuel J. Trychin , John F. Hughes , Lubomir D. Bourdev, Real-time nonphotorealistic rendering, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.415-420, August 1997 http://doi.acm.org/10.1145/258734.258894
Barbara J. Meier, Painterly rendering for animation, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.477-484, August 1996 http://doi.acm.org/10.1145/237170.237288
Ramesh Raskar , Michael Cohen, Image precision silhouette edges, Proceedings of the 1999 symposium on Interactive 3D graphics, p.135-140, April 26-29, 1999, Atlanta, Georgia, USA http://doi.acm.org/10.1145/300523.300539
Eero P Simoncelli, Edward H Adelson, and David J Heeger. Probability Distributions of Optical Flow. In Proc. IEEE Conference of Computer Vision and Pattern Recognition, June 1991.
Synthetik Software. Studio Artist 1.1. Software package.
Robert C. Zeleznik , Kenneth P. Herndon , John F. Hughes, SKETCH: an interface for sketching 3D scenes, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.163-170, August 1996 http://doi.acm.org/10.1145/237170.237238
Links
Full Text
http://www.mrl.nyu.edu/publications/painterly-video/hertzmann-perlin-npar2000.pdf
